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This evaluation study of the Educational 
Opportunities Fund (E.p.F.) was designed to answer eight general 
questions: (1) to what extent the S.O.F. program has achieved its 
intended objectives; (2) what byproducts in terms of educational 
programs, innovations, and so forth the program has produced? (3) how 
well ^ave the individual E.O.F. projects in school districts have 
^rj&aidzed their stated 'objectives; (4) what administrative, fiscal , ok 
.other effects have been produced at the school district level by the \ 
introduction of the E. 0. F .'^program; (5) how valuable the funding of 
projects is on the basis of proposals as compared with the formula 
financing;. (6) what the specific changes in E.O.F. program policies 
and procedures .ar_e which would improve the quality and long-term 
productivity of the projects; (7) how well E.O.F. (Compensatory) has 
realized its stated objectives; and, (8) needs assessment regarding 
tffe secondary component to E.O.F. — what the perceived needs, if any^ 
of clients relative to a secondary component are; if positive, what- 
the nature, scope, and modality should be. The data sources on which; 
this report is based are interviews and an analyses of documents, A 
structured interview schedule was used for the 337 interviews. 
Persons interviewed included central and regional personnel, board 
members, teachers, principals, parents, and others. (Author/JM) 
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Qiapter I 
I ntroduction and Overview 



In August of .19Vi the Research Director [A.Maakay] was asked by the Albert 
Department of Education to design an evaluation of the ^duaational Opportunities 
Fund [E.O.F.]. A contract covering the time period September 1st, 197I1 to 
November 30, 1975 was signed between the flinister of Education and the Governors 
of The University of Alberta on Januaiy 29th, 1975. Undlr the' terms of this con- 
tract, eight general questions were identified for the stW. They were as 
follows: \ 

: [1] To what extent has the E.O.F. program" achieved! its intended 
objectives? . 
[2] What by-products in terms of educational progrins, innova- 
tions, etc., has the program produced? ^ 



[3] How well have the individual E.O.F. projects in school 
districts realized their stated objectives? 

What administrative, fiscal, or other effects b^ve been pro- 
-duced- at f he"' "S choor di strict;"" level , "by " the" int ro'duc t ion ' "of"": " 
the E.O.F. progrrjm? 

How valuable is the funding of projects on the bisis of 
proposals: a:3 compared with formula financing? 
What are the specific changes in E-O-F- program policies 
and procedures which would improve the quality ard long-term 
productivity of the projects? 

How well has E.O.F. {Cornpencatov'>j) realized its qtated ob- 
jectives? i 
Needs assessment re' secondary co^ ijonent to E.O.FJ What are 
the perceived needs, if any, of -lients relative !to a 
secondary component? If posit:ive,. what should bi the nature, 
scope- and modality? 



[6] 
[8] 



/ 

/ 

• / ' 

Dui^ing the time period September 1, 191h to May 1, 1975 work on the pro- 
ject was focussed on design of the study, collection of documents, and prepara- 
tion of the research team and the data collection instruments. In May, Jiine, 
July and August members of the research team were in the field collecting data 
•and, later, analyzing the data that had been collected. 

Originally the evaluation desi^ included three major data sources: 
intervievG, a qiiectionnaive survey, and a dociment analysis. However, after 
the interviews were completed and a preliir.inary analysis of the data obtained 
from the interviews was complete the Department of Education and the Research 
Director agreed that the questionnaire survey would be deleted from thevstudy. 
Therefore, the two data sources on which this report is based* are the inter- ^ 
views and the analysis of documents. 

The Research Team 

The research team was comprised of two sub-units one of which conducted 
the interviews and site visits and another which analyzed dociaments obtained 
from the E.O.F. office in' the Department of Education, Edmonton. 

Interview <'md Site Visit Tean i. MeGcrs. Robert Mahcn , Dounlac Boughton, and 
^ Jeremy 'SimriG carried out the interviev3 and visits., Mr ... i^hen was ■a-Ph.D; 

candidate in Curriculum Studies in the Department . of Elementary Education, while 
Messrs. Boughton and Simms were Ph.D. students in the Department of Secondary 
Education. 

/ 

Document Analysis Team . W^ssts. John Ilavsky , Suee-Hin Toh and Donald Wilson 
carried out the^analysis of documents. Messrs. Ilavsky aiid Toh were Ph.D. 
candidates iX^the Department of Educational Administration while Mr. Wilson was 
a Ph.D* c^didate-in the Department of. Secondary Education. 

^ ^/ At one stage in the evaluation design, the Research Director proposed to 
employ a Project Adminictrator; but as the time available became short it was 
/decided that the day to day administrative arrangements couI.d most conveniently 
be handled by the Research Director arid members of the research team. Miss 
Shirley Culic, Department Secretary in the Department of Elementary Education 
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■played a key role in the administrative aspects of the oper^tiin. 

i 

As a footnote it can be said that availability of humin resources is a 
severely limiting feature in an enterprise of this type. One\ has to, in- 
evitably, rely on people who have other full-time commitments 'as graduate 
students or professors. In this instance, it was fortunate that some well- 
qualified and dedicated people were able to give some of their time to work 
on the pro.iect. The need for some agency to have people on a stand-by 
rapacity for projects such as thin one was made evident by this jjarticular 
experience . 

The Evaluation Desi^yi 

A3 mentioned above, the sources of data were: (a) interviews and site, 
visits, and, (b) analysis of documents. The interviews and site visits were, 
of course, the major source of data and Chapters I I - IX inclusive of this re- 
port provide the findings. In Chapter X, th6 document analysis is described 
in terms of scope, techniques of analysis, and results. Therefore, the design 
details in this first chapter will de^a only with the interview and site visit 
scmple and procedures. 



In Table I, thr- cample of per3r.>n.s Lntervieved in described. Table II 
contairiG a breakdovn of the project diatribution in the ''population'' of EOF 
projects and describes the smnple chosen for interviews and visits. In Table 
III, the identification of types of projects in the saTiple and some informa^ 
-tion as to location, rui-al vs urban, arid size is provided 

\ 
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Table I 
Persons I ntervieved 

\ 

Central Office 
Regional Office 
Board Renbers 

— ■ -Prlncipais 

Parents 
Other 
TOTAL 
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Tablft 1 1 1 

Analyolo of Project Types, Location and Size (Indicated by Cost] 



' *oject l/pes 




Zones 


Rural 


Urban ' ;ize (by Cost) 




Cooniun 1 c at 1 ons 


2 


5,1 


1 


i 


11,5 


Project Size 
Code. 


Cocnaun i c a 1 1 ons /M ed i a 


1 


1 




1 


U 


Field Trips 


1 






1 


3 


l-< 1,000 


"Fine Arts 


3 


J' »5 »2 


1 


2 


1^.3,2 


2- 1- 5.000 


Fine Arts/PhYS Ed. 


1 


6 




1 


3 


3- 5- 10,000 


Fine Arts/Field Trips 


.1 


6 


1 




3 


U-'lO- 20,000 


LangiWLge Arts 


9 


j:: ^ c 1. 1 
3.2.2.1 


h 


5 


22.19^6.,13, 


5- 20- 30.000 


Language Arts/Feading 


7 


6,5,5,^^,3, 
1.1 


6 


1 


13,11,10,9, \ 
9.6,3 \ 


6- 30- Uo.ooo 


Languai?e Arts/Readlni^/Llbrary 


1 


2 




1 


5 


7- lo- 50,000 


lAn«ua*te Arts/ReadlnffAluaic 


1 


3 


1 




5 


8- 50- 60^000 


LonjjniflKe Arts/Headlng/Gpecial Ed 






1 




7 


9- 6o- 70,000 


MathecAtlcs 


1 


5 




1 


13 


10- 70- 80,OC-0 


Ma t h V1& t i c 3 / " c i n c f 


? 


3.2 . 


1 


1 


13,3 


11- 80- 90,000 


Math/So i*nr<*j^»KjndoorK.J> 




k 








15—90- ica,ooo. 


*!ath/Sciencf:/LKe Arts /Read! np 


1 






1 


U 


13-100- 200,000 


Math/Sciencc/occial Studies 


1 




1 




li 


114-200- 300,000 


Reading 




3.3.3,1 


u 




13.9.5,3 


15-30U- l400,COO 


Science 








1 


U 


16-^00- 500,000 


Social Studies 




U 








17-500- 600,000 


Others - Gui'l/ince 


1 


2 




1 


5 


13-600- 700,000 


- Inte.9*fitetl C'orriculun 




U 


1 




]? 


19-700- 800,000 


- 3taff Differentiation ! 1 






1 


15 


CC-eoO- 900; 000 


- Learn ir.g Centre 


1 


-' 




I 




21-900-1.000.000 


- Ccaaaur.ity Bes:. irces 


1 


6 




1 


6 


22- > l.ODC.OOO 


- hiarli' r/i/heacir.bcr. | 1 


6 


1 




13 




- Oral Krf»nch 




6 


1 




U 



TOT.U.S 





9 




10 


z 


I 


1 


z 


2 


3 


1* 


5 



^ 21 

iProJects Vieve'! 
Jeaeh 7one. 
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\ . A structui'ed intexTYiev schedule was used, for *the: 337 interviews. Because , 
of^some differences in perspective ajnrag the .various sub-groups there was some 
variation in tl^g^uestiorxs asked.^ The inte:^view schedule is in Appendix A of 
this report and-/bhe different, questions for sub-^oups in .the sample are shown 
on the different ^e:tsions of page ^ jof schedule. 

In ^ each ^ase the inter^^iev was -plarmedx to ^ last' .from 30 - 50 minutes. The 
interviewer^' to,^K a ^;it. qf. time, to explain thfeir rol^'to the subjects and to 
assure them of c^inplete. anonymity . At the end of each clay's work in the field, 
the researchers i^xmnoxize^ theii- interview schedule'- data 'and observational data 
obtained at the project sites. ^After all of 'th,e interviews had been completed 
the research gro^p '^pent ^ considerable amount of tiiue back at the University 
campus developij^g a ^yste^ for sujnmarizing and analyzing the contents of the 
interviews, - * 

^ There ve^^e a gre?at ^'-iny aif f^erent types of responses to the fairly open- 
ended questions in tjie r.ci^^'4ul^>, and as leads to 'new 'information appeared, the 
researcherr^ prol^z-.-d i^to intoresting areas of inquiry. While the end' result was, 
in the Research Pir^-t.^r'S opinion, murh more valuable than data from a structured 
u;^ostionnaire uix/'Ve.v', t.hr . ^^jk. of content analysis beciiine rather monument aj , 

! In .reporti-^C trio finriinr^: from thif; phase of the study, the response tupe:r 
devfjloped dufinrr th^ content ^maiy^is will be used as the framework for reporting. 
In each case' th^ P^'^>cent'j,n- of respondents "who annvered in a particular way in 
reported and th^f^ /lUy.ntit i in/'-^rmation is used as a basis for' drawing con- 
elusions. V/hiif. thl^ ki^d of :ij^-lysi:3 depends on rather .arbitrary "™Z.{S?i? of thid.ib'' 

'J.O0S .enable-- ^^^^ef^'^clV^^" to --^.vroid roliurice on general, impressions , interviewer 
\:ii±s, and 3o en. • ' . 

In other Ih'^' oontorJ^ analysis of data obtained from f ace-to-f ace , 

probln.fT, open-etiJed inter^iowin^-- produces 'i level of ricor which Justifies the 

Tlir- nimTi^ ry ^.lC'ji:y the - ^'i/^i:'.-.!.! interview j r'l'V.ocolG are not included 
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in the report simply because they are so minute in detail that they do not 
readily provide information to a reader. . However, they are stored at the Unlr 
versity and will not Ij^e destroyed until after the final report has been 
received by the Hinister of Education. 

Overview of the Report 

.This report is comprised of eleven chapters, Cnapter I provides an 
introduction, description of the study, and an overview. Chapters I | - IX 
inclusive provide the findincJ^ on the eight general questions. Chapter X 
includes the description and the results of tne document analysis and Chapter 
XI summarizes the conclusions and includes a set of recommendations. 

Chapters I and XI are designed to serve as a short version of the report 
for ready communication to readers who do not want to deal in;'grea;t detail with 
the basic data. Therefore, besides the official 12 copies of' the full report, 
the Research Director has prepared IP copies entitled "A Summary of An Evalua- 
tion of E.O.F." 
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Qaapter M , - 

Achievement of Intended Objectives of EOF Program . 

OnJ;y a small niunber of the people interviewed had a clear picture of the ob- 
.. jectives as listed in EOF documents. In general, there was a positive response 
to the question regarding?; achievement of objectives. Mastery of basic skills was 
ranked hi^^hest while enhancement of pupils' self-confidence was second highest of 
tiie specific objectivos identified by the respondents. In-order to provide a 
more detailed picture of the responses and of the level of response by certain 
categories of persons interviewed, the following sections of this chapter will pre- 
sent ^ 'cate^Tjries or types of responses which the research team developed from 
their field notes and interview schedules. In each case, the response type will 
presented and then information regarding the strength of support for that re- 
;:cnGe will bo provided, 7Tip rcci70>u^.e types in some cases represent verbatim 
r.tatement^; r:y individua..:: . In moot cuces, however, they are' intended to repros<:'!it: 
.?L-ttement3 wnich v^iried jf;r:iOv;L/].t in word in;; but which contained essentially tlie 
LJ.'ijne information, 

• n thii^ '^•napt'M' 'i.n.i ■ \] '.'f-|u{.i;t oh-i^pterr. of tho report, the ronponse f-.y^o 
vsi:il \viv^- ad.-if:ont to it 'i -tat.oniont a:> t'-. the frequency of its appearance in Lhe 
r-t.n].lr.- o:' int'Tvi ^^wl; . In r* 1 tn r;urjrj.r :i -/.e the response frequencies, an arbitrary 
rn i^. wa;: iiied , a:; Vc] j r)\r:\ : - 

^-^"^ to lOO'o of intnrviav)i!::r. made the rosponryc, it Is labelled Ufrjh. 

If 31% to bOyo of mtorv.ieweer. made the rasponso, it Is labelled Mcd-'wn. 

If I'i to 30-. oi: interviewees made the response, it is labelled I^oio . 

rV-Ilowin/.;; the [^r^i-entation of e.-tefi :-:e't of rocponso tyy^er, a diiicncaion of the 
in ternn --f i'.s r:i,'-r)i ri(*ai/:e for the i,tiidy and some informntion regarding sub- 
rvALi.: of res].ondenti,^ .ill i.e presented'. It -daould be noted tliat, although the 
^.xnber of people ma>inr p/irticulai- recponse was low in some eases, there was '.m 
'.idviitive or oomposit^r. etTect in:>ofar ac we were able to group porAtive re^^ponses 
v/ni-h focussed on different facets of the r.ome central question. 

ERLC 9 
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Responses 

[1] (a) The objectives of the EOF pro/^ram have generally been achieved [HigJi] 

(b) The objectiver-; have been •^..-^'-leved in' a limited way [Low ] 

(c) The objectives have been achieved bec'aiiscj/they " are ,.so broad 

it v;ould be difficult not tO' achieve thefn [Low ] 

/ 

. ^(d) The oh.jo-tivr.'.; have probably been achieved - [[^w ] 

Discuaaion 

Ml '-rit^^rcyrle:'. !;'.v)i>] Intorvievcrcl had a mcdiwi or high frequency response 
nf the type .i .lent 1 Tied a:_: [j] (a). Th-'- :u?hool board members and central office 
3taff were in the modium cHtorr>ry [ViC 'ind y)% respectively) while principals, 
classroom teachers and proje-t teachers were in the high frequency category. ?Jo 
notable differences between rural and urban respondents or amonc respondents in 
the six zones of the province were evident. 

It was clear that :;^ron,- .rapport for this particular [l (a) ] responc:e 

type represents an endorsation of the EOF nro^^ram. 

/, 

[•?] Objective qne^ {''nicuyter^n of La^^ic uy-d cw^Uiainj nkllW) has been: 

(a) well achieved [Medium] 

(h) most 7L.:iblr. [ ' ^^^^^^ ] 

(c) not vel.l ach Loved [ Low ] 

(d) difficult to nieas^ire " [ 'Low ] 

Discussion 

Tl:e only notable de'/latifjii from the general picture shown above was on the 
part of school board members who mentioned response type 2 (a) in only 29% of the 
cases. 
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' The over-all frequency of mention of 2 (a) was which suggests that, 
in the minds of the people interviewed, the evidence is not yet available 
that would enable them to provide stronger support. The fact that the pro- 
jects had not yet run their full course and that product evaluation evidence 
>'as not always available may explain the medium frequency l?vel, 

[3] Objective tuo^ {''maintairtuig ov iyicvea^ing self-confidenae and self-respect'') 
has been: 

(a) well achieved [Medium] 

(b) most visible [ ] 

(c) not w^ll achieved [ . j^^^^ ] 
-.(d) least visible [ 1 

Discussion 

Central office personnel and project teachers in rural areas were generally 
stronger than their urban counterparts in supporting response 3 (a). In. fact, J3% 
of the project teachers in rural areas made that particular response while only 
Wo of the urban project tcacherG responded in this way. No obvious explanation 
for the difference can bo nrovide^] at this time. The fact that the total response 
wa3 in the Modiwn oixtf^r.ory r.urj':e-.L:: that evidence on the achievement of this ob- 
jective i'^ not yet well ^.levelope^i at the project level,. Af^ain, a possible need, 
for product evaluation rnay be indicated. 



[I] Objective thrze {''v !.rihilit}j of upgrading aotivitieo'') has been: 

(a) well achieved 

(b ) most visible 



[Low] 
[Low] 



(c) not well achieved [Low] 



(d) least visible 



[Low] 



(e) too early to, Gay [Low] 
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Discussion " .. - 

The only deviation from the general- response picture was on the part of pro- 
ject teachers in urban areas who indicated, at a Medium frequency level, that this 
specific objective was well achieved. This is not surprising in view of the 
probability that special projects as an aspect of "upgrading activities" are new 
to many rural settings because of scarcity of funds. In Zone #3, in particular, 
this response was quite evident. 

[5] Evaluator's (i.e. research team member.) observation of link between needs 

served by project and program goals. [Medium] 

Discussion 

Because the research team actually visited the sites of the, projects as well 
as interviewing various people, it was poGsible for them to make their own jua^nent 
as to the congruence between the needs served by each project and the goals of the 
£0F program as stated in prof^ram' documentation. 

The observation was • particularly well supported by the evidence availab'-e 
from rural projects. As.; a commentary on the def^ee to which project goals are com- 
patible with (,'eneral pro,-am fioals these observation;: iire especially sifgiif icant . r 

[6] Instructional servlcsfi rrro o>i±nr: 

(a) Directly delivered to students ^ . ' f fi^^jj^ ] 

(b) Indirectly deliverorl to students [ ^^^^ j 

Discussion 

Across all categories response type ^ (a) was mentioned by 7h% of the respon-.' 
dents. T?ie detailed brcakdrwi of responses was, in part, as -follows; 
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r 

Rural board members 






Utban board members 


14% 




Central office personnel 


56% 




Rural principals 


90% 




Urban principals 


82% 




Rural classroom teachers 


100% 




Urban classroom teachers 


64% 




Project teachers 


' 77% 




Parents 


78% 
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The only major deviation from the general trend was on the part of urban board 
members who did not mention response type 6 (a) to the same extent as other re- 
spondents. One should note, however, that when their (i.e. urban board members') 
responses to 6 (a) and 6 (b) are combined the total response is 285?. Moreover, 
one should not infer from a low frequency response that negative conclusions 
shoold be drawn. In spite of this caution, the deviation is interesting and is. 
Perhaps, worthy of future study. - 

One can certainly say on the basir, of these responses that there is strong 
•"•virion.:^- to support u oonoluGion th.-iL services are beinc;' delivered to elementary 
::tu(len(,:; by EOF fifojoc-t;: . 

.'.'] (m) InstrucLional a'.,r,ist.'ince ir; being delivered to teachers MUrIi] 
■:. ? Instructional --i-s distance is »j£t being delivered to teachers [lotj] 
(c) Assune it must deliver instructional assistance to teachers [Low'} 

Discussion 

In total, 70^ of the respondents mentioned response type 7 (a). Classroom 
teachers (91/^), principalr. (86?$)^ rural board members (80^) and project teachers 
in urban areas (75^) were particularly high in this category. Again, one of the 
major objectives of the EOF program appears to have been achieved. This finding 
'.•oupleu with the information about direct impact on pupils supports a conclusion 
that the' program has been effective. 
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[8] Achievement of the objectives of specific ^projects hcis been limited by: 

(a) Teachers not using available services [Low] 

(^) Amount - of- money available for specific projects [Low] 

(c) Unwillingness of teachers to participate [Low] 

(d) Doubts about longevity of program [Low] 

(e) Lack of expertise in prof:ram writing, [Low] 

Discussicm 

These. particular response types were not frequently mentioned by respondents 
in any of ' the categories. In the minds of the people interviewed, liii;i.tations on 
the achievement of project objectives were not significant. Given that the pro- 
jects were funded for a limixed time period, the low frequency of mention of 
response type 8 (d) (i.e. ''doubts about longevity of progmrn'') is significant. 



\0] The statea objectivf^s: in Ihc EOF docuinents aro not unique. They are general 
goals of education. i'^urmarkino- infdies: 

I'-ij" Insuf fifjiervjy t^onnr^il i'MrLiinr. [Low] 

(b; I'oor administr.'it Lon [Lov] 

(c) Poor teach [n.-^ ;;err<;r:x'inco -'or 1 Yarioty rr;asons > [IjOw] 

Diooussion 

. A very.,iov percentage r.r r?::5].ori.:c3 :r;ii.-ated >:cgatrvc views about earmarked 
funding:. Only 6;^- of school board ir.er.\oer3 interviewed responded in each of the 
three types listed abovr^. One -i-nclu:; : can b-- drawn that f undine of this type is 
not cor.cji.iored bad in nrl::^ iri'.-. ' \ 
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[lO] Parental involvement in the EOF program has been: 

(a) non-existant [Medium] 

(b) limited [Medium] 

(c) extensive [ Low ] 

(d) increased [ Low ] 

Discussion 

The responses shovn above were general across all categories of respondents 
(includinf^ parents). Rural classroom teachers (73:^) were particularly strong in 
mentioning response 10 (a). Rural parents and urban principals did report some 
increase in parental involvement. 

It can be concluded th.?,t the parental involvement goal of the EOF program 
was not realized. ' , " 

Conclusibnc 

li] .THE OBJECTIVES OF THE ' Z a.V,..:.'.; HAVE GENERALLY BEEN ACHIEVED. . 

iflASTERY OF BASIC AND AUXILIARY' SKILLS HAS BEEN HODERATELY ACHIEVED. 

•'•I HAiNTENANCE OR INCREASE IN PUPILS' SELF-CONF I DD^JCE AND SELF-RESPECT HAS 
BEEN nODERATELY. ACHIEVED. 

L^j VISIBILITY OF UPGRADING ACTIVITIES IS GENERALLY LOU. 

;:"T THERE IS A nODERATELY STRONG CONNECTION BETWEEN PROJECT OBJECTIVES AND 

EOF PROGRAi-1 GOALS. 

INSTRUCTIONAL SERVICES ARE DEFINITEuY BEING DELIVERED DIRECTLY TO STUDENTS. 

INSTRUCTIONAL ASSISTANCE IS BEING DELIVERED TO TEACHERS. 

; ACHIEVEnETvlT OF PROJECT OBJECTIVES IS NOT APPARENTLY BEING LIHITED BY . ■ 
VARIABLES IDENTIFIED 3Y THE PROJECT PARTICIPANTS OR OTHER RESPONDENTS. 

:>j THE CONCEPT OF SPECIAL FiJNDING DOES NOT HAVE NEGATIVE CONNOTATIONS. 
':] PARENTAL INVOLVEHENT, IN KOF PROJECTS IS GENERALLY LOU. 
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By-Products of EOF 

The Research Director believe? that an evaluative study is not eomplete' un- 
less questions are .asked about the by-products {both positive and ncgaiive) of the 
program oeing evaluated. In this case, the information obtained from , respondents 
proved to be very valuable as a basis for drawing conclusions about EOF, In the 
previous chapter it was clear that the basic objectives conceived of by the de- 
signers of EOF have been generally achieved. The information in this chapter 
attempts to tell the rest of, the story which,; in some'^ways, is more important' as a 
basis for evaluation. Recau^e this L.econd general quer.tion was the most open- 
ended one of a.H,^ a /L^rc-it many diffei-ent responses, were elicited. It was "in 
dealing with thi:"; cocond nuestion that' the content analysis approach proved to be 
of greatest une. -y 

Responses 

{I] (a) EOF hao produced 'l ;'o-.'i:iser.smer t , by teachers, schools, and systems, 

of the 'Gtate of education, [Low] . 

(b) Others are uemanding ziie c,ervh:e [Low] ' 

(o) A desire to expand thi;. pro^^rom has oeen created [Low] 

Discussion . 

. As in the cas-e in nost response tyi^es generated by this second question, 
the actual nujmber of respondents who made a particular comment is quite low. 
Therefpre' one should not infer that low percentage of responses of a particular 
type suggests lack of positive reactions. .. Each response type should rather be 
viewed as one faicet of a generally highly positive view o.' the by-products ,i of 
EOF. In this particular case, the comments speak for themselves and are quite 
positive In direction. 



[2] EOF has stimulated professional Qvo^ch in school district personnel: 

(a) through project initiated in-service programs [Lod'' 

(b) by specific program activities [Low] 

(c) by individual project activities. [Low] 

(d) through course work, professional involvement, etc. [Loh)] 

Discussion 

Once again the nmber of times each of Lhese responses was made is ]ow; 
but a scrutiny of the detailed data shows that principals (36^) and teachers 
{2h%) mentioned response 2 (a) fairly often, 

[3] The nature of professional grovrth mentioned above includes: 

(a) growing ^ awareness of the potential value of the roles of para- 
professionals, aides, .-,nd parent volunteers in education [Low] 

(b) ^;:rowth of knowlc-irre :ind transferable instructional skiUs in ' 
cor^tent are^K. ' • ; [Medium] 

(c) tencher commitment to specific programs [Low] ' 

(d) growth in ability of teachers to generate new ideas aimed at . 
dealing with specific educational needs of elementary students [Low]' 

(e) realization of the educational advantages of small group work [Low] 

(f) growth in ability of teachers to deal with specific educa- 
tional problems of eiementa.ry student?: [Low] 

(g) sensitization of teachers to alternatives with respect to: 

( i .) currieuliLT. [^^^'] 

( ii) methodolor./ [Low] 

(iii) materials and equi;:n:ent [Low] 

( ivj organizati'-.ii of curriculum materials [Lou)] 
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(h) growth in ability to identify individual student needs [Low] 

(i) growth of administrative skills in some school district 
administrators [Low] 

I 

Discussion 

Response type 3 (b) vas mentioned frequently by principals (58^), class- 
room teachers {73%) and project teachers (61%). Response 3 (d) was mentioned 
fairly frequently by board members ik7%) and central office personnel (51%). 
Response 3 (f) was mentioned by 65% of central office people and by 50% of the 
principals.in the sample. Responses 3 (g) (i, ii , iii) were mentioned by class- 
room and project teachers fairly frequently. Response 3 (h) was mentioned by 
38% of rural central office personnel, 36$^ of rural principals, 65% of rural 
classroom teachers and 39% of the project tekchers. 

t ' ,. ■ ■ 

EOF has engendered the following insights: 

. (a) of school district personnel into the administrative 

structure of education -[Low] 

(t) of school district personnel into the benefits arising from 

requirements to, develop proposals for special grants ' [Low] 

(c) of teachers and adm i.ni-t rator-. into the benefits derived 

from clarifyin.'?: e-iacat.ionaj objectives • . [Low] 

(d) of parents into the probl<.>;n.: of c-ducatlnr, elementar;^ students [Lolj] 

(e) realization that adequate .lervir^es re^mire full-time, not 
part-time personnel 1 

■ (f) realization that children can take i^ore resr.onsibilif/ for 
their educational program 



! LO'^^ 



Discussion 



Responses by parents er.Dr.asized the conuaent rej,re3ented by response type 
i. (d) as 8352 of rural parents and 3^% of urban parents mentioned the in.'Urhtr. 
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they, had gained into the _problems of educating elementary pupils. The other re- 
spondents all offered these conmients an indications of positive side effects. 

[5] EOF has allowed school district personnel to initiate projects (and 
consequently,, convince boards of their worth) which otherwise were ' 
Viewed as too expensive. Gome of these projects are being continued 
>^ on board initiative. [Low] ■ 

Discussion 

This response wac made by h3% of urban principals and by 30^ of rural 
board meinbev3. It is one of the numerous comments elicited by our question 
about bylproducts which seemed particularly worthy of note as positive evi- 
dence about the program's effects. 

[C] EOF hru; improved Lhr, quantity una qirU Lty of communications at specified 

levoir, (e.K. t.caolioj-r. uh.irin- uks-iG with other teachers, etc.). [Medium] 

DiGcuiision 

An t-xaniinritinn ot" tno 'let'alea breakdown of responses of this type shows 
Lhe •ollowing: - 

Uural board morntcrs 4q% '\ 

Conti'2l office porsonncJ j . 55^^ 

Rural cIassroo::i teachers , 73?r, 

Rural parents so% - 

Urban paront^- ' gQ':^ 

The response wns cornmon -i-ros:: ull .^ix r.ones of the rrovince and is suggestive of 
:i discrepancy that niu^.t -h'lracteri the work style of many teechers who are not 
mvo^lved with pr ;j- olh,-r ^onj:i work in the , elementary schools of Alberta, 
/is a pocitiv- .-.'io--: c ' 't, thlG Ir: ;.not:ier one which is particularly striking. 

; '-i; EOF . ;r -i-^a .-i-..v:ta in ^rvalaalive iikllls of ::chool dii:triot 

ner..:;noi f^^^^^j" 
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[7] (b) EOF has produced a growth in awareness of the need for 
evaluation in education 



[Low] 



discussion 



Rural board metaberr. (^^0:^) ard 39';^ of central of fice personnel . nj-ntioned 
response 7 (a). In cippraisinr; this response one needs to take acco'ont of the 
analysis contained in Chanter X of this report before drawing any hard and 
fast conclusions about the statue of the art of evaluation. 



[8] (a) EOF ills 3tin;uL:ited local curriculum development 

(b) EOF h;23 stimulated curriculuin development to meet local 
(and individual) :ieed3 . * . 

(c) EOF has stimulat-d curriculuin development demons tra'cing 
new approaches (e.F. classroom teacher initiated production 
of materials ) 



Discussion 



[Low ] 
[Low] 

[Low] 



Urban -entral oWic^. p-rscnn^^l (3S?), classroom teachers (31%) and pro- 
ject teachers ( rr-ntioned rei:ponne 3 (b) moderately frequently. Some 39/1 
of o^ntrnl nrvir- j,o.,,,r.. r-nti-rio.; rr-snnnne M (c). ^horo Is some support, 
UvT^iVnr^-, for a ^-un^'i j.uofi th'-/. cur^vicul^am develoF)ment: has been enhanced. 

19] EOF has produced positive changes in: ' 

(a) ^:taff ( i ) attitude [Medium] 

( ii) morale [ j 

(b) Student ( i ) attitude [Medium] 

in) morale [ ^^.^ | 

Discussion 

Favorable effect- on r,-aff and student attitude were generally perceived 
by the respondents. In p-rticular, claGsroom teachers felt that teacher and 
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student attitude had Leen positively a'rf.?cted (38% and 6l% respectively). Fro- 
jpct teachers also felt that teacher' and student attitude had been imprdved. 
Sbme 83^ of r-aral parents and 35% of urban parehts felt that pupils' attitudes 
had been Improved as a result of EOF projects. 

[10] EOF has produced positive community reaction. [Medi'Mn] 
Discussion 

All categorioG of respondents, except for schbol board membars, mentioned 
this response fairly frequently. Rural board members (30^) did mention it some- 
what frequently. As a ''roUHcar side-benefit , this, on'e is extremely note- 
worthy. 

[11] Reinfediation deliver=-a to students under EOF produced benefits in other 

. ■ [Low] 

D:iz^cu.G::ion ^ 

^ Parents made this >'-.-iJonrie fairly frequently, particularly the parents in 
ri:ral loc'i.tions (3?/^}. ' ' 



[12 J EOF has saved administrative IL^e, 



[Low] 



DipcusGion 



. Some scliool principals ;i.r:i a fev; classroom teachers made this -response. 
No board members or central office personnel mentioned it. ' . 

fl3j Minor, pro,1ect-ST,>eci f'i:? problems such as: 

(a) difficui' experienced by new teachers entering a iocally 

ijeneratc-J project [ro^] 
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(b) resistance of some teachers to new programs [Low] 

Cc) loss of student time in other areas when receiving 

remediation [Lc/d] 

(d) stigma felt by students receiving remediation [Low] . 

(e) jealousies and uncharacteristic behavior of some students [-FjOW] 

(f ) staff jealousies of apparent .light load of remedial teachers [Low] 

(g) tendency for teachers to ''off-load'' problem students onto' 
remedi3l per^>onn^^l ' [Low] 

(h) established precedent of released time for teachers to 

attend workshops . [Low] 

(i) resentment by teacher;; because of additional paperwork in-« 

'^ol^^'-^ :/ [Low] 

(j) skepticism about the value of central office experts [Low] 

(k) frustration produced through limitations imposed by EOF 

program /^jideline about expenditures for materials [Low] 



Discussion 

The only notable exception to the pattern of low frequencies of these 

response types was with resp^rct to }r (d )-T(stip7Tla effect) where 33% of project 

teachers in rural areaj r.ennLonr-i Lhi.s ac; a problem. 





prol. 


criteria 


tii:ie 


and 


(a) 


the 


(b) 


the 


(c) 


the 



[Low] 
[Low] 
[Low] 



Discussion 



Although the frequency of response l^i (a) was only 29% for the wh^le sample 
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there was a higher frequoncy of response for some , key sub^i;roups.: 

School board members 41% • 

Rural central office 67^, 

, Rural principals . 4e% 

. Urban principals S0% 

Rural classroom teachers 61% 

Total rural sample 37% 

■Response 1^ (c) vac mentioned by h3% of urban board members, 38^' of 
rural. central office people and 32% of rural school principals. Response type 
Ih (b) w'i3 mentioned by no board members and by only % and 2% of central 
office and school principals respectively. 



Conclusions 



[1] THERE IS FAIRLY STRONG EVIDENCE TO SUGGEST THAT EOF HAS PRODUCED THE 
FOLLOUING BY-PRODUCTS: 

(a) growth of knowledge and transferable skills of teachers. 

(b) parental insights into the problems of educating elementary childre 

(c) hoard member r.upport for projects which would otherwise have not 
been rupvorted, 

(d) increased communication among professionals. ^. 

(e) improved ntujf and student attitudes. /; 

(f) positive oorrm^nity reaction, 

(g) admini.itrative demands were worth the effort in view of the output. 

(h) apparent ctigma effect for some rural pupils. 
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THtRE IS TENTATIVE SUPPORT FOR A CONCLUSION THAT l':OF HAD 7WE FOLLOUl 
BY-PRODUCTS : * 

(a) increased pro fessionat growth cf teachers^ 

'(b) increased teacher sensitivity to alternative's. 

(c) increased teacher ability to identify individual student needs. 

(d) increased evaluative skills of school district personnel. 

(e) stimulated local curriculum development activities. 
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Chapter IV . ' 

Achievement of Intended Objectives of Individual Projects 

One of the most difficult problems to be, dealt with during the design' of this 
evaluation was caused by the sheer scope of the program. There were approximately 
.500 individual projects in operationjiuring 197^-75 representing many different sub- 
ject areas and involving large number 5 "bf-..^rofessionals and pupils. A thorough 
evaluation of any one^ of the 5OO projects would have required a full scale design 
and the work of a fully staffed evaluation team. Such an approach was not at all 
feasible -given the time-^line for the evaluation as well' as the limits in availability 
of human resources for evaluation. Therefore, a deliberate decision was made to 
limit the evaluation to a cample of projects which, it could be argued, would repre- 
sent the/ total list of projects although not selected in a particularly rigorous way. 
That sample of projects is described in the tables -included in Gaapter I of this 
report. Our site visits and 'interviews enabled us to produce some surface!^ 
answers to this question. In no way did we purport to carry out thorough evalua- 
tions; rather, we relied on the opinions of knowledgeable people and on o\xr own 
j advents as to evidence for or against the success of projects. As a passing com- 
ment, one can suggest that there 'exists in Alberta a strong need for increasing the 
availability of eva].Uatton skills. More will be said of this in later chapters of 
the report; for the- moment, the comment is made as part of the background to this " 
particular set of findinf;;r. . 

Responses • . 

[1] Confident "7^5 " with stron'g evidence, [Medivjn] 
Discussion 

Response frequencies, except for board members, were Medium or High for all 
categories of rf^spondents . riot surprising vas the fact, that project te^achers in 
rural (67^) and urban (5<S7o) schools were confident that the projects had been ■ 
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successful. Parents (hlf.) . regular teachers (35^), principals {k2%) and' central 
Office people (31%) were also positive in their "assessments • The evidence here 
was quite clearly in support of the effectiveness of the sample of jDrojects 
examined by the research team, 

[2] Confident ''Yes'' with questionable evidence. '[Low] 

Discussion - v, 

Only- the parent <^iroup made this response frequently. This- was particularly 
so in rural areas where 50^? of the parents made a positive statement. ■■ The es- - 
sential difference between this response .and response type [l] above is that the 
persons interviewed were not able to satisfy the research team that good evidence 
was available in this second case. 

In general, these responses add support to the positive finding reported 
under [l] above. , \ 

[3] Confident "Yes" with little or no evidence. [Low] 
^ ■ 

Discussion 

Again, the research team was not satisfied, in this case, that adequate 
evidence had .been offered,,.tP supi)or-t any positive comments. •'• 

t^] Cautious "7es" with admitted (or obviously to research team) limited 

evidence. \Law\ 

Discussion 

Rural board members: made this comment fairly often. 

[5] (a) "7es" with uhstated limitations • [Low] ' 

(b) ''Yes" but limited; all aims not achieved [Low] ' 

(c) "7es" but limited; not all students benefitting [Low] ^ 



[Low] 



[$) (d) "Yes" but limited; -aims not achieved 

(e) "Yes" but in a limi1?ed way because not all teachers are 
cooperating in the program - • [Low]' 

(f ) "Yes" but lack of money is restricting fullest possible 

\ achievement of objectives [Low] 

■(g)- ''Yes'' however greatest results limited to the lower grades [Low] 

(h) \ ''Yes'' but not all projects are achieving their objectives • [Low] 

^ '(i) l/"^es" but limited by inefficient organisation and/or 

\administration at the local level [Low] 

(j) VYes'\ put limited by staff turnover ' [Low]- 



Discussion \ 

Taken \together, these 10 response types are positive support for the 
Effectiveness ; of the projects— modifier by certain constraints in the situa-- 
tion. Project teachers, partigularly in rural areas {Sl%) frequently made a 
response similar to, 5 (f). I.e. ''lack of money is restriating full achievement, 

[6] Not familiar enon'rjn with projects to respond. [Low] 
Discussion , . .. 

I'Very few people nade this comment. It may be inferred, therefore, that 
in the lig^t of the generally positive asse.ssment reported earlier in this 
chapter,, pe'ei^le are able to make a decision about effectiveness of projects 
even though t%y have been operating for only a relatively, short time. 

Conclusions 

[1] INDIVIDUAL PROJECTS SUPPORTED BY EOF GRANTS ARE SEEN AS GENERALLY 
SUCCESSFUL. X 

[2] TFtRE IS soTiE Diversity in the ahount and quality of evaluative 

EVIDENCE available TO SUPPORT THE. VIEW THAT THE PROJECTS ARE 

-■■ ;; -^FfEmvE-.-- V^^^^^ .• ,. 

[3] . THERE WERE NO NEGATIVE RESPONSES TO THIS QUESTION (i.e. PROJECT 
SUCCESS?) FROn ANY OF THE PEOPLE INTERVIEWED..- 



Chapter V 

Effects on Administrative and bother School District Factors 

The, fourth^ general question contained in the terms of reference for the 
study was intended to enable, respondents to talk about fiscal, administrative, 
and' other effects at the. school district jjevel. In somey respects this question 
overlaps with the question about by-products of EOF [Chapter ill].- However, it; 
seemed worthwhile to enable the people in our sample to offer comments about 
''administrative'' as well as " educational" side-^ef fects • 

R esponses 

[l] ^Disproportionate use of administrative time in dealing with 

V'red tape". (Neglect of other: administrative^ dutie^ ) , ' [Low] 

■ ' ' . 

Discussion . - 

Although the over-all frequency of this type of Response was Low^ some 
details meri'c reporting: here: 



Rural board members 60% 

Urban board members 43% 

Rural central ol^fice ^ 52% 

Urban central office - 50% 

Rural principals ^ 41% 

Urban principals 36% 



Administrators and board members clearly saw problems in this regard. An. ex- 
amination across zones of th- pro/ince nhowed that people in Zones 1 and h 
made this- comment morp^ frequently than people in the other four zones , ..It can 
be concluded that local adjainistrtitive time had to be used to obtain and 
manage the funds. , ' 
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[Low] 
[Low] 
[Low] 



[2] Difficulties produced in staffing EOF projects, (Staffing 
pressiiri? was /IncroaGod by delays in approving projects and 
also, by an apparent shortage of some types of ^peciaiists). [Low] 

Discussion 

- . , 

Coupled with the belief that there was an oversupply of teachers 
in Alberta at about the time that EOF projects commenced, this finding 
is not surprising. One would vaxit to obtain additional data, howeVer, be- 
fore concluding that specialists were indeed available in sufficient 
numbers even given. the low frequency (30^) of\his response, 

[3] Increase in administrative load through: 

(a) short lead time^ 

(b) changes requested, in proposals 

; ; (c) increase in staffing pressure ^ 

; (d) other administrative staff being partly relieved of 

:re^lar duties to deal, with :[Low] 

(e) need to clarify, roles because of additional people 
; in schools (paraprofesslonals , volunteers , etc) [Low] 

Discussion 

Rural central office personiiel (865^). frequently made a response 
•similar to 3 (c). This was particulary the, case in Zone 1 where; 100^ of 
the people pterviewed (central office and school board members ) -made this 
comment. Iii general, however, ohe frequency of comments of tlie types out- 
linec^ above was low. Those who made the comments were emphaHc In kh.ei.r 
statements but their numbers are low, ^ ■ " 

c 

[M (a) Anxiety and pressure produced by delays in approval [Low] 

(b) Anxiety and pressure produced by uncertainty about future ' 

of program ^ [^^j 



Di'scussipn 



Urban central office personnel {35%) mentioned response h (b) fairly 
frequently. In Zone U, k3% of the urban subjects mentioned response k (a). 
Both 'Of. these responses sjiiggest some anxiety and concern regarding -Admini- 
strative effects; but no extensive concerns* were .evident. 



[5j: (a) '* Frustrations produced\by ncn-field-tested guidelines for 

i (b) Frustrations produced. by tvivialitif of changes requested ■ 
^__in proposalt^^ ^ ) ^ [Low] 

\ ( c ) Frus t r at i ons " pr oduc ed^ by e valuat i oh e f f ort 5 [ Low ] 

I . ■■ . 

][d) FrustrationG produced by lack of communication about what 

is going on elsewhere [Low] 

; (e) Short lead time made for fragmented programs [Low] 

\ (f) Frustrations produced by limited time made- available to 
I teachers to prepare for new programs [Low] 



i(g) Frustrations produced through inability to re-allocate funds [Low] 
D iscussion 

; An examination of the ''ietaiJ.(>d rm^lysic of this set of responses showed 
that the frequency of rojfxjnne v/ais .-generally low across all subgroups with one 
exception. Response 5 (a) C'non-Lcc ted guidelines'') v/a^ mentioned fairly fre- 
quently by rural (38$?) and urban (*40;'^) central office personnel. 

? ■ ■ 

[6] Generation of local suspicion of the motives of the government: 

(a) Attempt to gain partial control of local funds [Low] 

(b) Attempt to initiate special projects (then pulling out) 

leaving local areas to ''pick up the tab'' [Low] 

(c) Some resentment that a bureaucracy of nonT-functional 
consultants is being created [ [Low] 
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; Discussion ^ \ - 

In general, these responses were made by; only a few of the people inter- 
viewed^ There seemed to be no widespread suspicion of the motives of govern- 
ment in launching the EOF program. ' 

[7] Produced minor adminiGtrat,ive difficulties (e.g. timetabling,' 

: [Low] 



Discussion 

This response was made by a few principals, project teachers and central 
Office people; but no widespread reaction was apparent. 

[8] Skill in-.the art of /rr ant sman ship was developed in school dis- 

^ [Low] 

Discussion 

A few board members and central office personnel mentioned this as an 
outcome of the EOF program. ■ Other^^ise, this response was not often made. 

[9l EOF 3-yeai- projects mi^litate against ■ long-range planning in school 

districts. • . f^^.j 



Discussio n 

A few- people in each category of respondents made this type of com- 
ment; but there was no general reaction to this effect. 

[lOj EOF stimulated more positive use of specialist consultant's time. [Low]' 
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. discussion 

Central office personnel and principals were the only, respondents 
to make this type of remark. 

[11] Pressure to ge "OF money has caused a ''casthig- around'' for pro^ 
jects at the . . 

(a) school level^^ ^ /* [^^^j 

(b) district level ~ [Low] 

Discussion ' 

A small number of principals offered response 11 (a) while? a niimber 
of board members (rural members 30^) and central office peopl- mentioned 
11 (b). One can infer that this effect was not perceived to be widespread. 

[12] Primary needs were not rit tended to in "top down'' model of 

. proposal developir.rjnt • [Low] 



Di 



sous SI on 



A few central orricif i.eople and school principals made this comment. 
[13] Adminis tractive cr.nu^unications have been improved by EOF. [Low] 
Discussion 

Rural project teachers f33f>) were the only group; to mention this re- ' 
sponse fairly frequently. 



[l^] (a) EOF pro/^r-ams ire becoming increasingly more expensive for 
local districts to run. /uixi'^-ties are produced because 

difficulties in deterniininf: costs each year. [Low' 
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[ih] (b) EOF has involved parents much more in budget decisions,. [Low] 
Discussion 

No parents made response Ik (b). Some board members (rural members 
30^) and central office personnel made response ih (a). 

[15] Difficulties in dealing with the inflation factor vere experienced. 
EOF. funds do not adequately cover this problem. Consequently, 
some prograjns are threatened. Projects using paper materials ex- 
perience problems because df rapidOy increasing costs of paper. 
Smaller rural districts expressed difficulty in financial planning- [Low] 

Discussion . 

Rural project teachers (38%) made this type of response fairly often. 
Over-all,, this comment was made by 12% of the total sample, There:Was, In 
other words, some isolated concern for inflation, 

[16] Difficulties with accounting were experienced. (e,g, 3 financial 

years per project overlaid on to conventional fiscal year). [Low] 

Discussion 

A few central office people, principals and teachers mentioned this as 
an effect of EOF, But no strong reaction was evident. 

[17] EOF has involved more people in educational decision-making 

(decentralization), [Low] 

Discussion .•; , 

^ A few principals and classroom teachers kadi this comment, Ao parents 
or board members referred to this by-product, it Should be noted that this 
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and other comments described in thia chapter may overlap somewhat vi'-t;^ re- 
aponsea obtained to our ^enoral research question- nuinher two. 



Conclusions 



[1] FOR SOHE SU8-GR0LPS, PARTICULARLY BOARD HETIBERS Al\n> ADH I INI i STRATORS , 
THETJE IdAS A DISPROPORTIONATE AflOUNT OF ADflllNJISTRATIVE TiflE USED 
BY EOF AaiVITIES. . 



[2] STAFFING OF PROJECTS IdAS NOT PERCEIVED TO BE A DIFFICULTY. 



[3] RURAL CENTRAL OFFICE PERSOM\IEL REPORTED AN INCREASE IN ADHINI- 
STRATIVE IdORK LOAD. 



[It] SOHE ANXIETY AND CONCERN OVER ADH I N I STRAT I VE SIDE-EFFECTS WAS EVI- 
DENT. 



[5] CENTRAL OFFICE PEOPLE HAD SOHE CONCERN ABOUT THE GUIDELINES FOR 

BOF: . ■ 



[6] THERE IdAS NO SUSPICION OF HIDDEN HOT IVES ON THE PART OF G0VERM1ENT. 



[ 7 ] RURAL PROJEa TEACHERS WERE CONCERNED ABOUT I NF1_AT I ON I N ; COSTS , 
PARTICULARLY OF PAPER HATERIALS. 
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Chapter Vi 

Project Funding as Compared with Formula Financing 

The question of special earmarked funding versus ^^traditionaV^ financial 
grant formulas is a difficult one to deal vrith in any absolute terms. About 
all that one could expect to do in a study of this type was to obtain the -opin- 
ions of people who had been involved, in some way, with EOF, There are advan- 
tages and disadvantages associated with earmarked funding when it is examined 
from a theoretical point of view. In a given practical case, one may have to 
place heavy reliance' on the opinion of participants in funded programs. If a 
participatory model of educational planning is seen as important, then evidence 
of the sort presented in this chapter ' can be very significant. 

Responses 

/' 

fl] Project funding is preferred because funds are protected from manipula- 
tion (e.g. local budget shifts, A.T.A. negotiations,, etc). [Medium] 

Discussion ' ' ■ 

A detailecf breakdovm of results across categories shows: 



Rural board members 40^, 

Urban board members 43% 

Rural central office 52% 

Urban cen tral office 35 % 

Rural principals 55% 

Rural classroom teachers 44% 
Rural project teachers " 67% 



Across. all zones of the province (except Zone 5) the totals showed a 
medium response frequency of this type. Clear the notion of protecting 
the funds was supported by man^' of the persons intei-sriewed- 
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[2] Some of the stimulating effects of special funding include: sharpening 
of eduoational perspectives, enaov^aging creativity in teachers, en- 
couraging experimentation, obtainin^i cormitment from teachers, en- 
couraging board to increase httention to special needs of district 
pupils. ' [Low] 

Discussion 

Only in Zone #1 was there a ruoderately freq,uent occurrence of this re- 
sponse. Again, one should note that the Ic^^ freq.uencies do not at all imply 
'a negative view; but rather, the->absence of a ctrong, positive viev. 

fl] EOF has made pon.siblr projects that otherwise would never have received 
board approval. [Lod] 

Discussion 

Although +".he frequency of this orA oth^^-^" particular responses is low, 
one must look at the composite picture i order to rm3-:e a .iudgment . 

[h] Funding by proposal:: (in a ''grar.s 2\'C'^r" mode^ ' has allowed schools to 

determine and deal with educational problems i'. the local level, [Low] 

Di-^o ussion 

This comment wa.: marie by parentis aiid principals in particular • 

Depfirtment of Education criteria for assessing educational need are more 
objective; therefore, projects are likely tc be more wisely funded than 
if decision-making oc^nlrred at the local level. [Low] 

Discussion 

Only scattered ooirtment^ of thii-: type were made. Interestingly enough, 
some school board and central office personnel did make i-his type of response. 
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[6] Proposal funding represents a "bomo" of readily accessible funds other- 
■W1S3 unavailable through the foundation program. [Z^y] 

Discussion 

Some principals, regular classroom teachers, project teachers and 
parents made this response. No board members or central office people 
mentioned it . 

[7] Formula funding is superior to proposal funding because: 

(a) It eliminate,-, time consuming and costly "red tape" problems [Low] 

(b) It allow:; autonomy and flexibility [Low] 

(c) Criteria for assessing need are more appropriate at dis- 

'""'^^ [Low] 

Discussion 

Some of tho dr.taij.^^d breakdown of responses may be worth looking at 
even though the over-a].l response rate was low. 



(''■^) School board members 12% 
Central office ij% 
Project teachers ^% 



^10% 



Y (b) Rural board members 

Con tral off! co JOZ 
Classroom teachers q% 



6% 



(c) 

Board members 
Cen tral off i ce 7% 
Project teachers n?, 



These renponue types rn^c- roT.rc:-ont.ative of the fairly snuil] n'.mber which 
favored fjrmulM :.-:riMnc:i ■ t :. r-ro.ioct nmd.inr. 
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[8] EOF funds only get to schools or districts with expertise in proposal 



Dis 



cuss ion 



Only 3^ of the total sample- made this type of comment. 

[9] It doesn't matter which scheme for fundin;^ is used— the rules for 
funding should be such that needs are met and that it doesn'.t cost 
a great deal of money to get the l\mds . [Low] 

Discussion 

This infrequent comment is similar in tone to some of those made in 
response to the question about administrative side-effects. 



Conclusions 



[1] PROJECT FUND I IMG PROTECTS PROGRAfTS FROH flAN I PULAT I ON OF BUDGETS BY^- 
ADHINISTRATION AND/OR SCHOOL BOARDS. 
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Qiapter VII 
Recommended Qianges in Programs 

^ „ Any evaluation of a relatively new program should attend to the question 

of program improvement'. The literature on educational evaluation contains many 
references to the tern ''fomativo evalua,tion'\ This is the use of evaluative 
data to provide a basis for improving programs as opposed to making deci^'sions 
about termination or continuation. \ 

In t^is study, the sixth general question was used to elicit ' suggestions 
for improvement. All of the recormnended changes are worthy of note even though 
the percentage of responses was loio in many cases. 

Responses • 

[1] Reduce red tape. [Low] 

/in exruriination of the catcr>oriei3 of respondents shows: 

Rural board memberc^ 50% 

ifrban board nK^mbers t i 

Rural central office 33% 

urban central office 40% 

Rural principals 32% 

urban principals 36% 

It can be concluded that a ''nignificant'' number of peopJ.e at the administrative 
level in school districts felt th^t ''red tape" was a problem in some general way. 

[2] Increase flexibility, yot r^etalji earmarking; [Low] 
Discussion 

All ui^ban boai-d members and 51% of central office personnel ma.de this 

. 43 
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type of remark. In some ways, this response type is related to the question 
dealt with in the previous chapter on project versus formula funding. 

.[3] Plan for a more realistic inflation factor. iLo;>] 

Discussion \ 

Very few people made this type of comment, f/hat "wore yealisUa" 
would be was not forthcoming from the people who did conment in this way. 

c' 

, '' ' - 

[h] Expand the program, i.e. increase the arnount-of money available to 

elementary schools. ; [Low] 

Discussion ' 

Urban classroom teachers (38,1), and rural project teachers (33^) made 
this comment moderate] y frequently. How much money vould be sufficient to 
satisfy the need they expressed is difficult or impossible to say. 

[5] Facilitate the flow of money to schools by 

(a) revising approval prcceduref^ such •■hat receipt of money is not 

contingent upon pcs3csGion of expertise in proposal writing [Lcvj] 

(c) providinr u '^rovin^f' pro;f)03al writer or increase liaison 

with, and arbiiniFtr-tive assistance , from the regional offices [Low] 

(c) providin/7; in-ser-vice work in proposal writing, evaluation, 

ard curriculum buildlnr [Lou] 

id) providing a more structured format for proposals [Lov] 

(e) Gliminatinc triviality of j^ropor^al changes requested [Lou)] 

(f) providinr: move information on how to get funding [Lov]' 

(g) providing money more oft-en than twice a year ' [ijOh:] 

(h) having loc-l TOF •■o!i^::.ol j^orsnn to deal with \Lov] 
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! ■ . ■ ■ . 

r^'.scussion 

■ The. responses outlined above were, in the main> from board members, central 
office people, and principals. They amount to a summation of small points to 
whi^h various participants addressed their attention. Hov serious in an absolute 
sense the perceived 'problems are i§ a matter of conjecture at this time. 

[6] Clarify the gxiidelines by 

.(a) defining the nature of the- administrative model to be used [Low] 

(b) specifying a decentralized model [Low] 

(c) {providing more clearly defined criteria [Low] 

Discussion 

Again, the response, frequencies were low\ but the intent of the responses 
was to provide government with advice that might be used to improve this or 
similar programs. 

[7] (a) Relax guidelines with respect to materials 

(b) Relax guidelines with respect to travel inonios 

Discus .si on 

Only a few people rnadt.^ t.her.e two types of - response, 

[hV (^) i^liminate red tape. l:y building EOF grants into existing founda- 
tion fund [Low] 

(b) ^Jstablish a sej^.r.rate fund for continuance of on-going progrruns 

and another for new programs [Low] 

Discussion 

no'rponn^: ■] (a) ol-.:arly overlai;}.)ec. with our prior question regarding 



[IjOw] 
[Low] 
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formula versus project funding. Some board members, central office pieople and 
project teachers made this kind of statement . , \ ■ 

[9] Increase lead time in future programs. [Lou] 
Discussion 

Vrnile the frequency of mention of this notion vas laio , those who said 
it did so with a good deal of emphasis, 

[10] Remove necessity for school board to approve projects, ' [Low] 
Discussion 

No board members ; but a few central office personnel and principals 
made this comment. It relates, in different ways, to the question of local 
autonomy versus central, i.e. provincial, control. 

[11] Provide money for administrative costs. [Low] 

Discussion '• 

In an earlier chapter, it w-us indicated that some respondents sav in- 
creased administrative costs ac effect of the program. However, only a 
small rnunber of people focutised on this type of recommendation when they 
were asked to suggest chsr.ges in the program. It may be inferred that, 
having stated the problem to our research team, they felt that enough had 
been said to provide a basis for chan,c;e. 



[12] Improve the quality of 
(p ) External evajuati 

(b) Internal evaluation 



(p ) External e va J uat ion [Low] 



[Low] 
Discussion 

. It was somewhat surprising, given the fact that our research team was 
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\ i • ■ ■■-■ 

ltsell Identified with an evaluation project, that a small percentage of people 

mentioned\this area of possible improvement. 

\ 

[13] Ensure\consistency of administrative action by leaving the final 

decision^ about project approval to a single individual, [Low] 

\ 

; Discussion - ' 

\ 

. All responses of this type cajne from central office people. It may 

reflect a fairly simplistic view about efficiency of decision-making. 



flit] (a) Have an oWl presentation as well as a written proposal [Low] 



(,b) Have the provincial agency act as an arbitrator if a 

school boai\d turns down a project which the school thinks 
is worthwhile 



[Low] 



Discussion 



A few school principals made these types of response. Nevertheless, 
the procedures implied by these comments should be looked at as possible 
features of this or similar programs. Certainly , 4^sponse ih (h) is weighted 
somewhat against local control if "loc;al" means school district; but in favor 
of local control if "local" means school. 



Conclusions 

fl] THE GOVERIMHEIMT SHOULD CONSIDER THE IPIPLICATIONS OF HAKIINiG THE FOLLOWING 
CHANGES .'N EVF PROCEDURES: ujuxu 

(a) reduce "red. taps" . 

(b) increase, flexililiiy , 

(c) t?icreas£ tlie a*nount of mGney per pupil, 

(d) ^ provide assictancc in pwposal h)riting . 

(e) increase lead time for Gimilar programc in the future. 
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Chapter VIM 
EOF (Compensatory) 

Although the impiementation o^ EOF (Compensatory) was still in its early 
stages, the Department of Education wanted to begin to exp3.ore its effective- 
ness. Our research team found that maiiy of the people interviewed felt that 
they knew too little about the Compensatory program and that they would prefer 
not. to comment at all. Howeyer, there were some respondents who, in the Judg- 
ment of our team, were knowledgeable about the Compensatory program and whose 
opinions were recorded. In this chapter, the percentages of responses are based 
on the number of people who ha^l knowledge of EOF (Compensatory) rather than on 
the total sample of respondents. This has the effect of highlight/ng the com-, 
raents which were made relatively frequently and seems to he justified because 
of the relative lack of knowledge about the Compensatory component of EOF 

Responses 

[l] (a) Too early to tell [Lod] 

(b) Successful but restricted in the sense that not enough 

ch:^.idren with real need qualify for help [Low] 

Discussion 

An examination of the details of responses of the 1 (b) type shows 

Rural board member::; 50% 

Cer.irctl office personnel 31% 

Urban principals 100% 

Rural classroom teachers 50% 

Urban classroom teachers 100% 

There was, clearly, concern about zhe effectiveness of the program in delivering 
services to children with needs. 
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[2] -Program has improved students' 

(a) self-image [/^] 

(b) motivation [Low] 

(c) breadth of experience [Low] 

Discussion 

No evidence seems to be available yet to enable respondents tp^ com- 
ment about the specific effects of Compensatory programs. Given their state 
of implementation, this is not surprising. 

[3] (a) Red tape is too restrictive. That is, many eligible students 
are denied necessary help because district personnel have 
difficulty constructing a satisfactory proposal or because of 
the restrictive nature of the guidelines [^igh] 

(b) The geograpnu* guideline is inadequate and/or unrealistic [Medium] 

[Mediim] 



(c) The g^aidelines are unclear or inappropriate and should be 
re-examined • 



Pis cuss icr. 

The coraments cited above provide a fairly firm basis for the conclusion 
that the rT^^idelines ^ov Compensatory programs should be carefully re-examined 
V'V t;he Department with the view of streamlining them as much as possible. 

L^^J fri) /ui uiidesirablr, lcibell:.nrj'' effect accompani^L: Cumpeni^atory irionies. 

Associated with thii. is che politically seu:jiLive requirement of 

proviri';; an ai-ea to he die advantaged^' in order to qualify for 
assistance ' [r^^] 

(b) Unnecessary du:.! L. ration of effort tlirou^^h ,':athoring data which 

are alread;y -ivai lable -^rorn accessible som^ces [Low] 

Discussion 

Urh-i c^-n tr.nl wfrir.v vp-.^cnne] (50?) and classrocin teachers (33r^) made 
: cno- -i (a) ;:iO'ie>*;i.^e f requeatly • Trie few people who made response 'typ^e 
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h (b) were highly emphatic. 

[5] Time is lost because of red tape. [Low] 
Discussion 

, Classroora teachers {67%) vere concerned about this matter. Again, 
it relates to some of oui' other findings about administrative costs. 

[6] Jealousies are produced because of friction between eligible and 

ineligible districts. [Lou)] 

Discussion 

Urban school principals (33^) referred to this political matter. 
[7] There are some difficulties in staffing Compensatory programs. [Lou] 
Discussion 

The frequency of this type of comment is as low as the frequency of a 
similar comment about staffing the Elementary component of EOF. 

Conclusions 



[1] EOF [COnPENSATORT] IS AT AN EARLY STAGE OF mR.EnENTATION AMD EVALUA- 
TION nUST BE QUITE TENTATh/E. 

[2] THE GUIDELINES SHOULD BE RE-EXAH I NED BY THE DEPARTPENT. 
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• . Chapter IX 
Need for Project Funding for Secondary Schools 

In addition to the evaluation of the EOF progrsjii, the Pepartraent of Educa- 
tion asked for a needs assessment regarding a possible extension of project^ 
funding into secondary schools. There was, indeed, a fair measure of support for 
the idea of introducing a secondary component provided always that elementary 
schools would continue to enjoy the special support provided by the existing 
grants. In other words, people whom we interviewed felt that, EOF had partially 
offset the ''disadvantages'' suffered by elementary schools because of patterns 
of prices and school district budgets, which were perceived to favor secondary 
schools. People in oar sample were worried that an EOF (Secondary) component 
might simply restore the perceived imbalance. However, as long as the elementary 
components would nof suffer, there was no "dog in the' manger" attitude evident. 

Responses 

[1] (a) Yes ' • [r^^] 

(b) Yes; but if tliere is a choice as to where tne additional funds 
should go it £:houTd be to e] eiTi-rit;iry . That is, money spent, 

here may reduce the present need at the secondary level. [Lew] 

(c) Yes, although inhere is great ^^r payoff from money spent on 
elementary schoolinr^. | [Low] 

Discussion 

Principals (32/.), na-al classroom teachers (35%), and project teachers (31^3) 
made response type. 1 (b) moderately frequently. While the response frequencies 
we!re low^ they were cl(?arly I'avorable. 

[2- (a) Yec, particularly at the Junior hifji level. [Low] 
lb) Yes, for alternatives to existing program.s. [Low] 
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[2] (c) Yes, thc\ir;h tinietat-ling problams at the secondary level may 
limit Che riexibillty of programs. 



[Low] 



Discussion 

Urban board memb-r;^ (J^y:^) and rural project teachers (33^) made the 
response 2 (a) fairly oTten. 

[3].^ (a) Extra money 1.^ :K?edod at both elementary and secondary 

lovelo. [-^^2^] 

(b) ^x"he regnala^^ T'nrr.iula Ainding should be equalized first. * [Lob)] 



Discussion • - 

Response 3 ^b) I'u^-'ests that people assjjr.e that the grants structure 
dict-aten bud^i;et:L.n^; ^t.n i expervlit-irep in school districts. Perhaos admini- 
strators and board ::i-rt-r:: ::hcvl'i be r-minded that the weighting of per 
pupil gr.-nta (Ijc''3 divz ii^iAw xn itself ^ weighting of budr.etary expenditures 
in favor or .^^oojuUm-:/ :.ur:]3. 



■■^n '-wo;/ I'rom -^ho elementary f^.mdi:^ . [Lc^ij] 



Dir-c''j.r>.r; ion 



cut 



'■ '■>/'■:■. f rf.^..':jiiu'^::i, vri th otherD reDorte^i in thr.s chapter; 



•..-:o::e '•^n.':o:ni3 at th^j elementary level 



.1' 



DiscTJsc i.or5 



.1-.:: b-'? encoiu^'i.rrecl at th^^ Gecondriry lev:;!. 
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[6] (a) Yes, the needs are probabl;;/- greater at ttie, secondary level — 
although d'.fferent. 



(b) Yes, although the focus would be different. ' [Lo 

Disc u ssion 

Tne.se two resp-uu^e types simply indicate the need to provide a 
different focus should a secondary component be established. 

[7] (a) No, the money 'should go only to elementary. . '[ic? 

(b) No. [Lo 

Discussion 

Only ^% of those interviewed made :in absolutely negative comment abou 
th:? .idea of extending special fiunding to the secondary schools. ' 

C onclusions 

[1] THE GOVERNHENT SHOULD SERIOUSLY CONSIDER EXTEND I IMG I'JOF INTO THE 
SECONDARY SCHOOLS. 



l.?J IF' A SECONDARY COHPONENT IS ESTABLISHED, IT SHOULD FOCUS SOHE- 
WHAT ON THE CONTINUANCE OF REHEDJAL PROGRAHS AS WELL AS ON 
UNIQUELY SECOriDARY SCHOOL PROGRAH AREAS'. 



Ciapter X 
Analysis of EOF Docu>nents 



Besides the interviews and site visits, the evaluation design called for 
an analysis of -a paurple of dcciamentr obtained . f rum EOF files in the Department 
of Education. This analysia^was undertaken in order to cross-check the informa- 
tion obtained from the other phases of the study and, dlso, to provide some 
additional information. In this chapter, the sample of projects on v/hich the 
document. analysis was conducted, will be provided. The scheme for analysis is 
provided in Appendix 8 of this report; but the format for reporting the data 
in this chapter will embody a fairly complete outline of the framework which 
was used. 

Description of Sample for Document Analysis 

1. All projects which had been selected for the interviews and site 
yisits (hj) (see Qiapter I for details of sample) where the criteria had been: 

(a) " DistriTjution by zone (approximately proportional) 

- urban and rural proportions 

- public and separate 
categories of subject area 

(b) Size of .r^rant made available 

- all ' f the most expensive projects 

- v^^'yy - fch) of the least' expensive projects 

- a somewhat representative selection from cacegories vrithin 
the middle range ^ 

(c) All of the projects highlighted in the EOF newsletter 

2. Ah additional 31 projects, using, the same criteria as ' in 1 (above), 
plus sever-al projects which had been mentioned by people during the intervievrs. 
These had been perceived to be exciting and successful or to have failed for 
some reason (n=l). 

56 
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The Format for Analysis 

In Appendix B, a copy of the form which was used by the research team is 
provided. This format was used on ^the total sample of 78 EOF project files. 
It, as will become evident in the followiil-fe sections of this chapter, includes 
straightforward information about the availabilil;^ and content^of dat^ in the 
files; but also includes, in some cases, an evaluative judgment as to ine 
quality of content. 

The heading'" and numbers used in reporting the data in the main body of 
this chapter ai-e tbo^e provided on the document entitled "Analysis of Project 
Documents." (Appendix B). 

■ The data will be reported under each heading and then the discussion of 
the findings and conclusions will be provided.- 

' • Criteria Associated with the Proposal 

1' Pundinq l evel and level of pre, eat imrlementation in sampl e of 78 
pro,jects . ' 



Funding Level ($) 







- 1,000 


1,000- 

5,000 


5,000- 
10,000 


10,000- 
25,000 


25,000-, 
100,000 


100,000- 
200,000 


200,000 


Level 


Distri-t (36) 


0 


0 


2 


3 


18 


9 


h 


of 


School (Ul) 


1 


8 


12 


12 


8 


0 


0 


1 mplemen- 


Classrooni( 2) 


2 


0 


0 


0 


0 


0 


0 


tation 


79* 


3 


8 


lU 


15 


26 


9 


h 



* - One project had dual emphasis hence n = 79 instead of 78 
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F unding ' empiuzGis , 





a 


b 


c 


d 


e 


f 


B 


flajor Emphasis 
riinor Eraphs r^Is 


Ih 


10 


23 


26 


28 


3 


13 


12 


0 


9 


2 


7 


1 


J. 




2b 


10 


32 


28 


35 


1+ 





Code: (a) in-service education of teachers 

(b) additional classroom teachers 

(c) non-clerical aides to support teachers 

(d) specialist services related to classroom teacher 

(e) materials for classroom, teacher 

(f ) adminiotrative/coordinating/planning services 

(g) other 



Frequency of number of different purposes cited in proposal documents 







No. of. 

Projects 


No. 


1 


31 


of 


o 


26 


Purposes 


3 


■ 18 




u 


3 



Discussion 

1. Many projects (li7 out of 78) emphasized more than one object of ex- 
penditure for the realization of objectives, 

2. Only categories "b" and "f" above constitute expenditures which 
might be challenged under the original EOF guidelines; some potential for 
abuse of funds occurs onder '*c" above (See I -3c and possibly I I -3c for use 
of aides as clerical personnel or perhaps other abuse). 

3. The general impression is that budget submissions tended to reflect 
the guidelines established for EOF. 
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3 . Rati onale for pro r jrxirn 

Present 76 

Absent 2 

Clear 66 

Ambiguous 10 



Discussion 

The progra:n rationale vas almost always present and vas clear in a 
substantial majorlX' of cases. 

^- Objectives for program 

[Stated 77 

[Unstated 1 

[General 37 ] Many projects had both general 

lupeciric 55 ] and specific objectives 

[Vague 10 
[Clear 68 

Discussion 

The statements of nroCTajr. objectives, were generally clear and were 
present in all but one of the cases examined. 

5- Dec><:^ripti o}i of prorjrcuv (Consi^:tent with objectives) 
Yes 73 
No 

Debatable 5 

Discussion 

Usually this r.ateri.il van requested by EOF office when it gave condi- 
tional approval or asked for more information (e.g. activities planned, 
na-.^e wf role of aii..., etc.). The projects were quite adequate on this 
criterlo:; . 
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6. (a) Program budget 
Yes 7^ 
No 

Debatable 



3 [Probably inissing .from files since EOF office was 
generally strict about budget description] 



( ) Budget fo'i' evaluati on 



Discussi 







% of Proposal Budget for Evaluation 




'L'otal Project 




0 


0<X - 1 


KX - 2 


2<X^5 


X>5 




< 


10,000 


20 


0 , 


0 


2 


Z. 




10,000 - 
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h 


0 . 
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\$ 
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5 


1 


2 


3 


1 - - 
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100,0.00 


6 


0 


2 




0 


12 


100,000 - 


200,000 


3 


2 


2 


1 " 


0 


8 


200,000 + 




1 


3 


0 


0 


0 


3 


on 


. 


10 


6 ■ 


13 


l4 
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1. The total budj^et of the 76 projects suj-veyed was $^,686,500.00. Total 
proposed for evaluation in budget submissions was $39,360.00. This represents 
less than ifo of / he total budget requectc . •• 

2. Well over half of the projects showed no "budgeted expenditures for 
evaluation. . 

3. Over two-thirds of the projects budgeted less than 1^ of their 
budgets for evaluation. , " * 

U. Only a handful of projects 'budgeted for evaluation costs of over 
$2,000.00. NOTE : It may be that evaluation costs were borne locally, 

60 




55 



f^vi denoe provided of 

(a) Parent Support 

Yes >U6 
r. No 32 

(b) Teaclier Support 

Yes 57 
No 21 

(c) C'ormriunity Support 
No ■ )fh 



M(:ch anisms for Parent Support 

Pafent-SLuff committee [4] 

Parent steering conmittee [3] 

Home and \School Association [5] ■ 
Parent surveys ' [loj 

Letters of support ^ [j] 

Public meetings [^1 

Parent- teacher interviews [4J 
Solicited parental involvement 

in program (Aides, etc.)/ [8] 
Post facto support (project 

existed before EOF*; [6] 
Parent identified program 

activities - , [1] 



Mechanisms for Teacher Support 

Parent-staff convilttee [4] 
Planning and development of 

program . [21J 

Teacher identified problems [5] 

Staff meetings [7] 

Teacher surx'oys [6] 

Task Force [i] 

Post facto [I] . 

Consulted by administration [3] 
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Mechanisms for Community Support 

County school commLttees [l] 
Inclusion in school committee [1] 
Community meetings [2] 
Individual volunteers [3J 
Public and private agencies and 
organizations (including Univ./ 
Colleges 5, YMCA, RCMP, ATA, AGT) 

[13] 



f^LB. . (i) Usually no .evidence v-is provided of survey results, 'In addition, 
vhea parents or the cominmiity are cited as having .participated formally or 
informally, the r.cope of -nippjrt i:3 not clear; e.g. one or two parents may 
bo counted ac support. r.Lnce EOF ^:aidelines did specify description of such 
support, the re.sult:: ^o: may bn over-estimating actual support. 

(ii) Thr: evidence aloO suggests that schools and districts may have" 
interpreted the notion of ''nuppoi-f' .-ts involvement, in the program during imple- 
mentation (e.c. pareuuG or ccr-nunity rr:e:Tibers . as aides, volunteers or resource 
persons) rather than as' ■ nvol\^er.ent diu-ing development of the proposals.. 

(iii) In one or tV':- instances, evidence was provided of student involve- 
ment in prograjn pl-ir:nliu:. Thic w-tr: ^t:i-iKinc in an cuMoor education pro- 
ject where some half-aov:en ^itudent c:orn.-ii t tees were sot uj^to plan for the 
:'ield tr.in:;.. ■ • ' 



Discussion 

The ievc}. of parent anci/or coinmunlty support i^ r.ot as strong ds might 

have been expeeted— given the EOr guide] ines. Howe^r, there were num.erous 

rather interesting meoh'^nisrr.3 for developing contact.^ between the school ,and 
its environment. 
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Firat draft of projjooal received '. 

(a) Approval • (lo) 
Conditional approval (5^*) 
More information re- 
quired ( u) 

(b) Where conditional or more information required, 
- follow-up is : 

Documented (50) 
Undocumented (8) 

(c) Critt-iria relaxed " i' 

Yes V (15) ' 

No ' . (60) 

Ambi.r;uouG , ( 2) . . 

Discussion 

■ The corresponclcnce between school/district and EOF office clearly indi- 
cated a strong concern on the : part of EOF to' ensure adherence to the guide- 
lines among all projects. Where criteria were relaxed, the action was taken 
only after considerable deliberation by EOF as justifiable under the circum- 
stances • Some types of criteria-relaxation were: 

/ " ^ney provided for food supplied:; owing to poverty of the cormunity 

■ - \ emp'hasi.'i .'not on direct cli25sroow delivery [2] 

- small amounts allocated to secretarial/clerical assistance [4] 

- supplies and equipment exceeded 50% of budget '[3] 

- money allowed for admlnlstrativc/coozdinative services [1] 

/ . ■ . ' . ' 

In general, the application of criteria was well-handled by EOF office. 

■9. Appeals ■ .■ ^: . 

This provpr] tv- lie a unelens categorisation. No data are re- 
ported. 
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!.0. t' mlmt ion (lr;:u,m .JomponanL; jn'opor.nd 



Frequency oitk which a specific component appeared 



a 


b 


c 


d 


e 


f 


S 


None 


Mixed 


50 


^1 


36 


48 


15 


32 


23 


6 


1 



Code ' ( a ) academic acjiievcmcnt 

<bj Student attitude/opinion survey 

(c) pre-post ,• ; ' 

(d) teacher attitude/opinion survey- 

le) administrator attitude/opinion survey 

(f) parent attitude/opinion survey 

(f^) other 



No. of Compoaenti 
No. of PrbbosalG 



' - N-' t-. ■ . - . 




3 


h 


i,Gnvr> per* 

5 


pvopoaaL 

6.. 




1(V 


12 


19 ■ 


■ Ih 


6 ^' 



Discuosion . 

•1. At least .-.iv (a, b, - , d, i" , ,3) different evaluation coniponents 

appeared i>equently in %hi, project proposals. 

2. Tlie averaf-re n-oinber of corr.ponents appearinR in the proposals was 3.S, 
indicating an intention to conduct /P.ried, if not extensive , evaluation. 

3. Given the emphasis placed on evaluation in the EOF guidelines, the. " 
:appearance of several evaluation components in project proposals may reflect 
that emphasis. 

U., With the _ apparently high, comnitment to evaluation expressed in the 
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proposals, the question of whether these evaluations were actually conducted 
and the nature of evaluation activity became important, (See M - Uc, 5a, 
b , c and 6 ) . 

5. -It is rGrhaj)G sreculative ; but the failiire of 6 proposals to pro- 
vide any kind of evaluation de::ign ini^-ht be evidence of relaxation of criteria 
by EOF office. 

In genera] , the vlani: for evaluation were present and were fairl^y, 
comprehensive. However, /;iven the budget allocations and other evidence 
available to the rosecirch teriri, the implementation capabilii-y is open t:^ ques- 
tion. 

1 I - Criteria Associated with Evaluation 

1 . Heeds ci^^c^i^rni^nt 

(a) Outcomes, objectives identified 



Ye:: (7),) 

i*'o ( )i) 

(l)) Adequate descrir.'li on of curi'ent state 

Te3 ( ;;8 ) 

•"Jo {2U) 

Caii't sny . ; (6) 

(g/ Research L^tucii^r'S cited 

•ies ^ (30) 

Mo (V3) 

/>'. bir^ouc ( 5 ) 



Discussion 

1.. A description of the cui-rent state was deemed inadequate if -nothing 
more than the statement;. :.^f the problem is given in one or two sentences. An 
adequate description is one which delineated in some detail the antecedents 
of the problem on which the project is based. (e.^. school norms of achievement 
compared with local or provincial norms). 
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2..- Research studies cited included research literature and local re- 
search studies conducted usually Yy central or regional office personnel 
and, in one or tvo instances, as part of community-wide needs assessment 
studies. Clearly, a majority of the projects analyr.ed gave no indication 
of being research based. 

Pi'ogran planning 

(a) Program outlined (See I (5 & 6) 

Yes (78) 

No ( 0) ^ 

(b) Probable success in meeting objectives 

Stated ■ . (Uo) 
Inferred (3'0 
Unnlear (8) 

(c) Success Gupported by ^ 

Pr(:ire;;3ional judgment (70) 
He-.se-irch evidence (I'l) 
'hi--, vu- ( 0) 



Discussion 

'me weaK rose.'tr-h : -rr.e in thr- j-roTran plannine stage was as evident 
it. wn.r, in th- ne-ir nn.-p.-,.^-.,. ..^..-o. ih^ quality of program planning 
evaluation seems. to have been bared primarily on professional judgment rather 
than evidence I'rom tii- ren,'-a-ca -m-i/or evaluation literature. Given the 
fact that evaluation of tho.v.- p.roj..':-+ r, , themselves, wan not well financed, 
one wonders -.bout tli- basl" I'or .iecision-makin;: on prop;r,am content. One may 
conclude that educational recearch did not have a high decree of impact on 
these project:^ . 
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Implementation ppocecij 

(a) Program carried out as planned 

Yes • (6)0 . . 

No ( 0) • 

Modified , . - (H) 

Unknown (6) [Usually meant no monitoring or 

progress reports were in files 
at time of analysis] 

(b) Nature- tjf 'fvidence supplied for implementation 
of pror;rn.n 

field office reports only [25] 

- self-reports only [36] 

• - both field office and self-reports [13] 

- no reports at all [4] 

(c) Difficulties reported on: " 
Inputs 

- weaknesses/difficulties in teacher/aide in-service [6] 

- staff, turnover [8] 

^. - insufficient provision for increased preparation 
^ tinye for teachers [0] 

delay in obtaining materials [8] 

i-ihortaqo in eifuipment/niaterials /facilities [7] 

Process 

- incvuascd workload on administrative staff [3] 
delay in proposal approval [3] ■ 

communication among participants , role ambiguities [6] 

- difficulties: or unwillingness of teachers to change [2] 

- ln.ipj,>ro!)rla&- of expertise [3] 

- scheduling/programming arrangements [5] 

Con text 

- f:.O.F. conr.traints on funding of clerical/technical 
services [2] 

- /1.7\/1. crlnlcism of aide utilization [1] 
lack of parental support/involvement [4] 

- inflation [1 ] 

Outcomes 

unanticipated negative consequences [1 ] 
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Discussion - 

1. Field office reports were available for approximaiely one-half of 
the projects , . . ' • 

2. Thprc vere only ono or -wo reports of' ''failure/' of project. Field 
office reportf^ vere alriorit inc'vitnhiy pcnitive. ' 

3. rue data cont;iir.ed in rhese sources coincided approximately with 
data obtained .from interviews and nlte viL^its. 



. Pvoqvcmi prog re I- s 

( a ; ■ Meet in^%b j ec t i ve s 
Yes 

■ No (10) 
Unclear (n ) 

No inforinr.tion (7) 
Partially (12) 

(b) iJature Oi' evidence 
Source . 

- only field report [25] 

- only progress report [36] 

- both [13] 

Documentei 

Yes fo9) 



[Clear (33) 
[Ambiguous (25) 



Discussion 



1. Many procres'j reports ai.:;arently came into EOF office only in late 
August and September; thus, files examined in July may contai:.; prof^-ess and/or 
field reports by "iow, 

2. Documented progress was defined as description of program progress 
which exceeds- one or two brief general statements and qualifies whatever con- 
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elusions are provided. 

3. In a majority of cai:>es, the progress reports indicate success. 
However, there were souie instances where progress was ^ not significant or 
where data were not available. 



Outcome evaluation 

(a) Evaluation rep^Ttr (rts oi' July/T5) 



Presented 



•en^ented 



ft. 'J'ltur- :-f' evidence 

Zt achor opinion [49] 

- administrator opinionfl9] 

- parental opinion [17] 
student opinion [22] 

- other opinion [ 7] 

- none [20] 



(c) Opinions 

Documented 
Undocuniented 



(d) Source of oj^inions 

l')valuation reports or pro/rreos repor- 



(e) dala 

standardized tests [11] 

prc-ix)>'it [ 9] 

controls [ 1] 

teacher ron.'itruct>}d [ 1] 

other I 6] 

none [20] 



e.g. inventory cf units developed ; 
inventory of library books catalogued/us 



(f ) Other corrunerjt.s on outcome evaluation 

(numbers refer to ^^^^yuil'j^^ir. of Project Documentr.^' sheets 
'1:3 identified by (/vxl.uation research team). 



(r) contM 



- '7/ar*fi" data not presented; but inferences as^to its 
av.Aj lability provided (tfl2, 13, 21, 24, 25, 32, 38, 43, 
51, 58, 59, 63, 64) 

- outCotne evidence not shov/n to be related to classroom 
performance (^15, 9) 

- ambiguous ^^havd^^ data provided ' i 

' . ■ . 

- focus on delivery rather than oatcdme\ '^ \{" ■ " * ' . 

- available tests described as not appropriate ^ s 

- Indication thai original EOF guidelines broken (i^e. teacher 
aides handling clerical duties (^23) ). " ' . 

- self-identification of project unworkabillty and request to 
discfjntinue (ir53) 

■< 

- argued in favor of perceptions/observations rather than 
^'hard'^ data (f^33) ' , , \ 

- belief statements, as evaluation (H56) 

- .-.hi ft from planned '\">oft'^ evaluation to ^^Ji/ird'' procedure (H51) 

isolated instance of negative critique of project by 
fieL."! office[(ft51)^ ^ ' . 

- inappropriate statistical inference (HGO)- ' , ' ' 

^aboratr: ovaluacion design and r€^ix)rt is shown by (il35) 
less elaborate; but fairly comprehensive design in (H50) 



D iscu.ssion 

The xn-'ir: c-nv: ro b.-- 'jj"!,wn i !ir;n thei^e dTitu i:^ that, evai'iation wis ^♦ 

ade<iuate3.7 inploinented i^m- Vn-: rr-at rnujority ijrr^jects analyzed, 

6, Pulfillrricnt oi^ : bor'Orcd ''I'alucirzon 'dec-upi ■ , • _ 

(a) COi!:pl<;i:.-: (in) _ " ' ' 

Incomr.leto (^^0 

i;ot done at a L.J. f 10 ) ' ' • . 
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6. . (b) Coniponents" rnlG:-unf^ (i.er proposed components) • 

- achievement/attitude tests [24] 

- student surveys I 4] 
teacher surveys [6] 

- parent suryjeys [ 8] 

- external evaluation (usually 

• F.O.)' ' [ 6] 

- inventory of materials used/ 
developed [3] 

- record of student activity [2] 



Discussion ^ 

1 . Of cases where desif'^i -appears to have been 'fulfilled, orlly a . 
few could be suid to have systematic and comprehensive procedures. 

: <\ This and other data in the files does not show any high degree 
Of con'cern by the EOF office with the lack of evaluation which is well 
't:*OMr^h':-out and systematically pursued.' - ""^^ 



Conclusions ^ 

il] PROJECT PROPOSAL!; UERE GENERALLY ADEQUATE AND IN LINE UITH EOF 
"GUlDELIfNES. 

f;^]^ THE cqF OF^FlCE ADniNrSTERED THE GUIDELINES CONSISTENTLY. 

( BUDGETED FUNDING FOR . EVALUATI ON UAS rXTREHELY DU. . . 

!^! PROPOSALS FOR CVaLUATION WERE REASONABLY UELL DEVELOPED. . 

!si EVIDENCE OF PAREinJT AND COHHUNITY SUPPORT FOR. PROPOSED PROGRAHS 

WAS NOT ^xtens've: ■ ' ..^ • . " ' ■ ' 

THE RESEARCH BASIS FOR PROPOSALS iUAS INADEQ.UATE. 
[V' INTERfNJAL AND EXTERNAL EVALUATION REPORTS WERE GENERALLY POOR. 
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Chapter XI . . 

Summary of Conclusions ^iid Recommendcations 

This final chapter is ccnpriGed oiVt-.,f. parts. First, a complete list 
of all^-of the conclusions lirsted at the end of each of. Chapters I I - X is 
provided. This i^ .^to provide the basis for a series of recommendations 
which comprise the ?^econu part' of the chapter. In order to link the list of 
conclusions to a particular chapter, their original numbering withj-n a 
chapter is retained. In the setrtion containing the recommendations, an 
Qttovt will be made to mrake the chain of reasoning and argument fairly clear • 
In some instances, the ch^-^i.n vhich linlcs a particular recommendation to the 
evidence obtained in the study may not be as clear as a purely 'scientific 
strategy would call for In those cases, the Research Director will attempt 
to make explicit any valae Jud.^nents on hi:^ part which led to a particular 
recommendation, 

Summary of Conclusions 

Chapter II f Acnievemert of h^.-^.cndea Objectives of EOF Program] * 

T>IC OBJECTIVES OF THE'^-;:F VUOGmi HAVE GENERALLY BEEN ACHIEVED, 

[2] flASTERY. OF BASIC AND AUXILIARY SKILLS HAS BEEN HODERATELY ACHIEVED. 

[3] MAINTENANCE OR INCREASE IN PUPILS' SELF-CONFIDENCE AND SELF-RESPECT 
HAS BEETJ MODERATELY ACHIEVED, 

VISIBILITY OF UPGRADING ACTIVITIES IS GENERALLY LOU, 

[5] THERE IS A MODERATELY STRONG CONNECTION BETbJEEIM PROJECT OBJECTIVES 

. : AND EOF PRGGEAl} GOALS, 

* ' * . -, . *^ 

[6]' INSTRUCTIONAL SERVICES ARE DEFINITELY BEING DELIVERED DIRECTLY TO STUDENTS. 
[7] INSTRUCTIONAL ASSISTANCE IS BEING DELIVERED TO TEACHERS. _ 

72 
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[8] AQ^IEVE^EIMT OF PROJECT OBJECTI VES IS NOT APPARENTLY BEING LIH I TED BY 
VARIABLES IDENTIFIED BY THE PROJECT PART I C I PAINTS OR 07>^ER 'RESPONDENTS. 

[9] THE CONCEPT OF SPECIAL FUNDING DOES NOT HAVE NEGATIVE CONNOTATIONS. 

[10] PARENTAL INVOLVEHENT IN EOF PROJECTS IS GENERALLY LOU. 

Giapter III [By -Products ] 

[1] THERE IS FA^RLY STRONG EVIDENCE TO SUGGEST TH^T EOF HAS PRODUCED THE 
FOLLOWING BY-PRODUCTS: 

(a) growth of hicnoleckje and tvayisfevable ckillr. of teachers. 

(b) parental inatnhU^ into the problems of educating elementary children. 

(0) hoard member support for projects which would otheinM^se have not 
been supported. 

(d) increased comniuni cation among professionals. 
... i 

(e) unproved staff and student attitudes. 

(f) positive eormunity reaction. 

(g) o.dminir.trative demand.^ were worth the effort in view of the output. 

(h) apparent sticjrna effect for come i^ur^al pupils. 

[2] THERE IS TENTATIVE SUPPORT FOR A CONCLUSION THAT EOF HAD THE FOLLOWING 
BY-PRODUCTS: 

i'x) hhireased p'j'Ofesr.i.or'uul groijjth of teachers. 

[h) iyicreacei tcaohev se^isitivitij to alternatives. 

:-::) increased teacher ubilitij to identipj individual student needs. 

(d) in^::rcac.cd ei^jluative skills of schooc. district personnel. 

(e) stirm^lated local cum^iculuin developine>it activities. 




Qiapter IV [Success of Individual Projects] 

[1] INDIVIDUAL PROJECTS SLPPORTED BY EOF GRANTS ARE SEEN AS GENERALLY 
SUCCESSFUL. 

[2] THERE IS SODE DIVERSITY IN THE AHOUIMT AND QUALITY OF EVALUATIVE 
EVIDENCE AVAILABLE TO SUPPORT THE VIED THAT THE PROJEaS ARE 
EFFECTIVE. 

[3] THERE WERE NO NEGATIVE RESf'OrJSES TO THIS QUESTION (i.e. PROJECT 
SUCCESS?) FROn AlW OF THE PEOPLE INTERVIEWED. 



Chapter. V '[Administrative Side-Effects] 

[1] FOR SOHE SUB-GROUPS, PARTICULARLY BOARD HtinBERS AND ADHIN ISTRATORS , 
THERE DAS A DISPROPORTIONATE AHOUNT OF ADHINISTRATIVE TlflE LJSED 
BY EOF ACTIVITIES. . 

[2] STAFFING. OF PROJECTS DAS NOT PERCEIVED TO BE A D4FFICULTY. 

[3] RURAL CENTRAL OFFICE PERSONNEL REPORTED AN INCREASE IN ADHINI- 
STRATIVE DORK. LOAD. 

[h] SOHE ANXIETY AND CONCERN OVER ADTl I N I STRAT I VE SIDE-EFFECTS DAS 
EVIDENT. 

[5] CENTRAL OFFICE PEOPLE HAD SOHE CONCERN ABOUT THE GUIDELINES FOR 
EOF. 



THERE WAS NO ;-UiPiCIOM OF HIDDEN HOT IVES ON THE PART OF GOVERNTIENT. 



[ f'l RURAL PROJECT TCAGCR^ UERF. CONCERNED AQOUT INFLATION IN COSTS, 
PARTICULARLY OF PAPER HATERIAL's. ^ 

Chapter VI {Pr^^.iect xv.vzw:. Firmi;.!. :. F..ia(.linr j 

[1] ■ PROJECT FUNDINlj f^ROTECTS PROGRAHS FRai HANIFULATION OF BUDGETS BY 
ADH IN I STRAT I ON AND/OR SO^00L BOARDS. 

(N.B. Intervievi; vith ASTA cfficialo revealed th;it tlicy fell. ti;;.r 
forinula fun iin;^ is pr'^'f er'^ble , ;."ome Department of Education 
official:; nu -^/^ested that the Department Ghould use L'pecial fr'idinr 
to enable it to r.r;;''/i .u.- .l.f'if:er."hip and then shculi incorjior-ite 
the monies into C'";".v-.-r.tion-^ 1 f'-'riimla fvmdinr). 
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Chapter VII [Recoirunended Qianges in EOF] 

[l] THE GOVERNTEIMT SHOULD CONSIDER THE I HPL I CAT IONS OF HAKING THE FOLLOWING 
CHANGES IN EOF PROCEDURES: 

(a) reduce ''red tapc\ (N.B, The term "red tape'' implies unnecessarnf 
procedures. See the ooramerts in the section of this chapter 

' O bservations for School Districts ) . 

(b ) increase flexibiliipj , 

(e) increase the amount of money per pupil. * • ' - 

(d) provide assistance in proposal writing. (N.B, The regional offices 
evidently provided a lot of assistance for proposal development in 
the early stages of the? present EOF program). 

(e) incr cao"'.3 Uad t/>i.i fo'^^ similar progi^ams in the future. 

.' ' ' / ' 

Chapter VIM [EOF [COrPENi:.^ •Ov 

[l] . EOF [COrPENSATOP/^ ! i; Af ■ 'j EARLY STAGE OF I nPLEDENTAT I ON AND EVALUA- 
TION nusT BE Qi? tlnta': ?7e. 

[2] THE GUIDELINES SH'JU.D !.;.;. ,':-EXAnil\JED BY THE DEPARTHl.'JT. 



Cnuntor IX lErter.Gion tr ... ■ lary Schools] 

[1] THE GOVERINirtNT SHOL^.D SERIOUSLY COIMSILLK EXTENDING EOF INTO THE 

SECONDA,''?Y SCHC/OLS. 

!. ! IF A SECOiMi>ARY COnPO'i-JJT IS ESTABLISHm), 17 .■■HC'JLD FOC.}:: •s.AC- 

LHAT ON THE CONT I fJU/^CE OF REHEDIAL PRvii.^:»-"iS AS WELL ON 
UNIQUELY SE<:O^JDAR•I' SCHOOL FWGRAn AREAS. 

OvxrAar X [Aniilyois ol* ;.-:in'- nt. j 

I .1 PROJECT' PROPOSALS WERE GENERALLY AI EQUATE AND IN LINE UITH yrir 
GUIDELINES. 

[ ; THE >/•' OFF I CE ADH I N I STERED THE GU I DEL I NES' CONS I STE^JTLY . 

[.:' BUDGETED FUNDIfC, FO^ EVALUA 'ON LIAS EXTOEIIELY LOU. 



PROPOSALS FOF EVALUATION (jJEF., REASONABLY JJELL DEVELOPED. 



[5] EVIDENCE OF PARENT AND COfinUNITY SUPPORT FOR PROPOSED PROGRAMS 
WAS NOT EXTENS f r. 

[61 THE RESEARCH [JA':!S FOR PROPOSALS DAS INADEQUATE. 

[7] INTERNAL AND aifr^NAL EVALUATION REPORTS UERE GENERALLY POOR. 

Sunimation _ 

^ ' In general, EOF [Qer.f: ary ] proc^ram has been a. succes:- ., The con- 

cept of special r-oiviin/: -'or -.ir.ary school projects has been extremely 

well received thvoup- v,i: -.r.:. nv .vinc^^ • Many of the administrative problems 
perceived by uart lei pants attributed to the short amount of lead time 

and to The lack of e:x:';v witi:. prr.jecc funding £md curriculim develop- 
ment activities. / '.^n Vc> -.-g oJ^ :t, the projects appeared to be successful 
althou^li there way; i 'Ity of ^-eaily solid evidence about the educational 

outcomes. . 

As a. mo'.:*^'' V->-r r.J -iri:aJ at i.nr lo,-al r-^^ivity and for focussing on ele- 
mentary pu])ils . flOF je^-^riel exc-el l ent. . ilovrever, :is p?irt of a systematic 
model for Inprovinr the quality of education it was, in our opinion, deficie:: 
in several important re::^e•7^n. fl] It. was not embedded in a short or lonr; 
range plar:.ir.: mole]. ai-M a improvin- quality (e.^> Lead tunc was ^rJiovt ayid 
there is m. ^-vt^^ifity al-y^u"- ':^o^^f-'Ky.at-'.oK of funding beyond three yearn). 
[2: It was not bar.ed (jn ref.oarcii knov;ledre about teachin£^ or learning or 
pupil needs, i ■■ ' The l-^.^h ..-f evaluative skill and evaluative evidence pro- 
vides l-i'.tle hop; for lonr-ter:.' laycff in terms of future shifts in the di- 
rection of elementary scb.oolin;^ in Alberta. 

In conclusion, while tiv- EOF i.rof:ram has been a success, it sm^-eks too 
much of :'on<^ nhof' effort. JS project fundinr is to continue to b.. used, 
it should be incorporate-i into a l';r/^er fra -work of educational plannia/- 
jwith a strong research and development component. It is obviously wcr .while 
^to consider spending more mor.:'-;r '.nr sele^iJ:,ed projects which have a stron^^ dis- 
trict or school fla'/^ir :is V-iv as ]-upil needs ^i.re concerned; hut a more"-<^fO- 
ordinated and systematic r.^^Tort is needed if future funds are to have more 
payoff for the whole system of elementary and secondary schoolinf.'; in Alberta. 
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Observations for School Districts 

Although this report and its recommendations are directed towards the 
Depa.rtment. oi'* Education, some observations directed towards school district 
personnel seem nebessary. These a.re put forward as the evaluator »s reaction 
to the points of view expressed by various people interviewed during the 
study and, in pai-t , to the proposals documented in the EOF files. They are 
intended to bo su^rrrestive cC areas where school districts should make im- 
provements if the niaxii-u::; possible benefits of project funding are to be 
realized, 

[l] There was evidenctr of two different models of project development. One 
was a centralized ''top-:iowyi'' model in which most decisions were made in the 
school district central orfice. The projects developed under this model 
tended to be large-sctile in nature. One apparent advantage of this approach 
wsa that system level problems were attacked by the programs which were 
eventually developed. Moreover, evaluative mechanisms tended to be more 
elaborate, thougzi not n--s3sarily r.ore sophisticated, in these top-down sit- 
uations. The other extreme model was a ^'grasn-POotG^\ school-based approach 
to project development. Hero, the projects were small-scale and were, 
typically, not subjected to any extensive evaluation. However, they had the 
appar-nt stren/^tli of iriVolvi:u.; teachers in decision-making about the problems 
facing the pupiln in t:lic'}' s.?Iioo1j. 

Given that ,the cv'aluation schemes which we encountered were generally 
not good, one could suggest to those employing a ''top-down'' approach that 
more &.ccess to decision-making be given to school staffs because the gains 
in apparent sophisticririon of program development and evaluation in a cen- 
tralist model were not usually realized. At the same time, important skills 
were nnt cein.:^ developeo, ■avonr, teachers and princfpals. 

[2] If the projects are to have long-tem effects on the quality of educa-- 
tion, school distrj.ctL^ Dc-e i to >--mted th^-ir project development in a planning 
model that emphasizes the following elements: 

(a) A thorougk necdo a^jaessment. 
(Note: The evaluation tea:ii is not convinced that projects were based on a 
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careful analysis of priorities vith respect to pupil needs. If project 
funding continues "beyond 1976, this component must be stren^hened) . 

(b) A basi's in iheory and/or pvaattae. 

(Note: The prd^ect proposals lacked a theoretical base. While this may be 
acceptable in the' -early otaAjes of a program, there must be a more thorough 
consideration of this element in future programs. It is up to the school 
districts to improve this r'eat/ore of future proposals). 

(c) A ''jtvojiq eva^luatiuyi component. 

(Note: Our, findinfr^; show that this component was not stronr;. While one 
cannot expect an overnif:ht;\ iiaprove:rient in the capacity of -chool districts 
to conduct evaluations, someXbeginnings need to be made. School district 
administrators and -chool cvards need to become not only more capable or 
conducting int-rnal evaJ.uations ; but more accepting; of their responsi- 
bilities in this real^n). 

[3] In a project based rror-am, there -./ill always be administrative demands 
on school districts. While these rr.ay ce viewed as ''red tars'' by some 
people, they are part of a normal Interohance between levels of government. ^ 
(Note: If funds were not o^^-rnarkt.i , much, nr the so-called ''y^ad tape" would 
disappear at the le/el of di;:tri':i: •.nrl wfovincial interaction. This would 
in no way fTuarante. nhai w.ulu \1 r-:me.-- •>.! the Aev:,l of central office 
and r^chool cnaff ir-t Vr.- •.■v duaoor i.i of hhe opinion that the 
administrative re^ra • -er-'- In h.arrrr'.ny with -.hf T,ro,ir-t funding; concept 
and th;.,t scho-.l di::Lri.:t : e^is-nrie] SaokVi -ontinuo, - they iiave done in the 
past three years, to inprv;.. ^ r ihiiis a:: prcjeet 'loveloT>ers ) . 
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Recommendations 

[1] continue: EOF [ELEDENTAR-r ] FUNDING FOR AN ADDITIONAL THREE YEAR 
PERIOD. 

Comment • 

Ths' extension of project fimdlng- for three morsAiears is inteizded 
to p.nahle sclwol districts to develop the suaaessful projects and to im- 
prove or replace pm^e&ts which have not. yet been successful. There is 
much to he^ teamed from the projects and iVr^eQ ifi^aTshaoe not really been 
Long enougn to get the max-i.mm payoff from the 'ext'ensive developmental 
w-jrk ana tne resources which have already been hvpested in EOF projects 
The. xntemal evaliiatzon of projects is only now being completed and time 
J or ■Lmpt'ooemeyit iu neccssaiy. During this proposed extension period, 
the ZO^ central office operation and bhn system of proposals for funding 
s}iould be mazntained bij the Depai'trnent of -Education. At the same time 
tne evaluatrvc and curricuUm developmental skills of school district 
personnel can be improved and used to advantage. 



[2] EOF [COnPENSATORY] GUIDELINES SHOULD BE REVIEUED BY THE DEPARTHENT 
AND PARTICULAR PROJECTS SHOULD BE SUBJECTED TO THOROUGH EXTERNAL 
EVALUATION. 

Conmient, ' • 




- ^ .,, . . ,, . . Jf 

.nr. '.;:\ ..ccc,:. , ho ^lu l i.nes jov uccear. to compensatory funding should be 
i^tci./' d so arj to coxc ' u-'^- r^ mcxil of u>me<jessary restrietions 

[ M AN Eor [SECOiNDAf^r'j CODPOrCNT SHOULD BE: INTRODUCED FOR THE 1977-7^ 
SCHOOL YEAR AND CONTINUING UNTIL AT LEAST 19/9-80. FUNDS FOR 
PLANNING SHC'ULD BE I^JCLUDED IN THE BASICTONTS FOR TI-£ FIRST YEAR 
OF OPERATION OF PROJECTS, - 



Coiiunenc 



The ovei*atioru2l o\itl'-:r fnv aeh! i^vinc: this ia ac folloioo.- 
(a) Anrx^uywc: 'Jtc c^:jon!:ir:f co^nf.onent during 297S-'7C Gchool ijcca\ 
ib) :'}iaourn;ie r^ljy:y::nr: dii}>f.r,j 19:' tJ-/? hij vcmiring proposals to 
ic. f):ibmtt^id, 7 rent^wLr deadline date (e.q. F^ibi-uainu 
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(c) For projects tMt receive approval^ include with the per pupil 
grant for 19?7'?8 an additioyial grant for planning (e.g. 
$3.00 per pupil). Thii^ i:ouM be a once oyilu grant; but would 
be available^ over the lifetime of EOF (Secondary) ^ for other 
newl,j approved projects ^'juving their first year of operation. 

The reason for this part of -the recommenclo.tion is that lead., time for project 
developing should be provided for any exteruiion of the concept into other 
grade levels. In general, given the favorable opinions about EOF (Ele- 
mentary)^^ extension of the project concept into other grade levels seems" 
appropriate.^ The okIj rider on th-^'s recommendation would be that such an 
extension of furvzing should in no way jeopardize the position of ele- 
mentary schools. 



Concluding Statement 

The d-:- contained, ir this report have been rather extensive. The 
oonclusions converged toi^ari a favorable assessment of EOF £er_ se_. Any 
doubts exT)ressed by tlie Research Director were mainly in terms of the 
long-term benefits of .^uch prc.f^.;L'^ims . How the Department of Education and 
the Government of Albert,;. ^111 use the infomation and the recommenda- 
tiono, will determine;, ultimately, tne value of this piece of research. 
It must be Jurif^ed in terriu^ of its usefulness -for and its effects on de- 
cision-making in Albert''!. 
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APPENDIX 'A' 
INTERVIEW SCHEDULE 

School zone number: 

School Jurisdiction: ' 

Name of the project: 

Naxie of the school: ^ ~ 

Position of the interviewee: 



There are two baf-ic (Jinensions to thij^ inter^/lew: the first one deals with your 
views of EOF in terms of the projeaiis ) with which you are familiari the second 
one deals with your views of EOF as a progran for the f-^mding of projects which 
deliver direct instructional services to students and direct assistance to teachei. 
throughout the province. 



SECT! ON 'A' 

The following quest i'JriS are conc*imed wi*;h the one or more specific EOF projects 
with vhich you are peVQonall^f farriliar : 

N.B. /ire, you fcar-iliai^ -rlth EOF elen^ntaiv. , EOF compensatory 

or* both : ' * 



Wha t fieej u^^o i h -'. 3 i ro je c r ia^ '^ned to aati sfy 7 



i>i: zu V'Lj'-. ixza tni,^ : Jl^ 



3(a) Has thic proj.i.^t ^.ct thn ■nnn.ie for uhinh -it L^as d^aiqned (i.e. achieve: itv^ 
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lias the tor I'l'.Ki.ict hccn ouc.^ ,uiful in dcliv.tvinq '\iirf.ct i>U3t2n.ctioml 
nervvceo to ittudenn: a>id dii^ect imtruational aeeistancc to teacheve''! 
(Probe for evidence). 



Has tnis EOF p2\^ject produced anv deeirahle or undedirablc r- .1^- effects 
that \:o^ can think of? 



More spocif icalJy : 

i. W^'^t irrpact has this EOF procect h^td on student and staff at titudec? 



W};at okillc, abiliticit or insifntj have you acquivcd as a result of 
your association i^ith thie particular EOF project? 



iii. HoJ has thio project affected your allocation of time and energy? 
(Probe for a personal reaction to this). 



ft 
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l4(b) contM 



thr oorrrunivif to this speci, ; project? 



rate i'\ t'.ir> ::■/■<*. 'V ' :^ d^i^: ^-'xtcKt hji.'c thcif 'iarx s;;';' 



The fcllnwin^ queatl n:- t^fxl y-.-jr i^" ZOf as a pvogj\z'^< for the fur.ding 

of projects? 

51a) From 'u cur v^nta^j-^ poir.t, ::c,i''^i; • r i hats the EOF progrcur in .^er.t^.2\il. 



ih] Look': v: i'.^- .* ■ . , • :V. \4(>u r^Vf. ,bc^.K ^ui'ilcd, uould ucu 

to '^o^*-' Ki '(..•;'-■ . - . ^ , J"' .* • r . ,j'X<iKt to which all cv :ny of t }\eoe 



6 4 b'av e you notir^jd anu b p. fi ?ic:l or Ufhicn irable admi nia tra tive, fiacal", oi^ 

ol^her non-t^^aoh^ no'lmrni til • ^t.; >jh:<2ri hav^; bean pvoduaed at the ac^pol 
distn'ct letini b-j th*". intro^iucuon the EOF progxyzm": 
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Yf i) In gcfier il y n ;'Je 'J^n^ ru,Jti^*ed any ilic n^ablc ur under.ii'oblc side -efj veto 
that the EOr :<v<)(n'ar. has pi*oduced1 



More 3i'ecirijallY. -i SlFERVISOR 

y - . . 

i. nave i^ou futij':.: any ru-:\' attituda: f^"" appvoachrv^ c*uj'idculuh: 



■icii'U r^-il-2>.d '1^:.' :.';c*;'''u:.:'.' in 'V^rjr^jj'Cfi^. 1^1.1 evaluation: ■A-'yVc;'. 

.*-ir 2h'' '. : ^. ■' - It u^i t.hC>i your Ju:*^' .^dic^tiot:'^ 



iii. .' uou think ih<,'. EOF pV0(jr-jr. hai' : yi,jr varied t'V* abilitu of pcrii\>njii!l 
.* ' gcy:*e:*<:tc i'd.'as atrvt^d -J^t .h^aUnn with ^ptcific cducatioruil 



iv. Do uou think EOF haa upgr\ided Vm ability of th^ trachtirc involved 
£:■'> deal vith svecific 'Educational "problems of eU?mimtary childveni 



V. iicive t^icr:'. bao: '.^^lamji a in the >i:icility or quantit-j of comnunica- 
tdonr. Lhir. -iouv yuj^icdii-rtion'l 



*vi. liar EOr iffect-id :5 to, ff utilization in qny uay'^ 



vii. IroDe: ro. any :ipLjifi<^ urydesirable side-efff.'cyte. 



In 'jani'.fat, kxvc uou noti,-ed any dcairable or un:hr,h\iblr a id*j -effects 
that the EOF progiham kati, fwodu-.^ed? 



More 3pecifioally , qs a PR I NCI PAL 



Do yo-^ think £0f has served to upgrade the ability cf teaahere to 
deal with specific eduaaiioruxl vroblt-imo of elementary atudentc? 



Has the tuve and effort re'Vuiv^d of your staff and yourself by the 
prog7\vn, been greater cr less than you had anticipated Do the 
benefits derived from this prog^wn justify ouch allocationel 



'.'•Tve ij<..u r'u)ticed any c?^:>:^e in t-e-.icher or student morale as a 
retmlt of partiaipation in the EOF program'^ 



flats :.ht EOF : r-ji.ru'^. -^y^dujcd sumifijoyit nci: teacher skills that 
you ccn'zidcr iesira:, n'l 



V. 7a e the ;:r-K^r*::m produced any cKzr^^. in parental involvement in 
education! 




that thr: •:or rrogt':^ 'uzl- proJur-ja': 



More spc-jlf':i:il2y , a PAR£i\l T 

i. Has th-r iTV.'clvc'i^-.n' p-xrrKt^. ''n 'the ^aiurr'iHnr cf th(eu^ ah''~ldvcri 
beer, Q'.afiif'^'\:ntl-j iK^rt'a.fcd :hi\rugh EOF? 



. i. t'.. Ihii' '. '■• ^ ;m'' - .'^Nv?:(r.', t t-:2t _thc pc:r€>'t role 
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h (c) 



7 ( a } In (jt^m rYil, havt' ^ru nr^iir* -A j^wj Je o i. vab le . LK'^Uclr'^ble sC!'- ^ffoc 
that thi> cor vvo-ji^iv iia.. pr'-.'.dxai-.' l'i 



( b )■ - .-• 3 p e c i r i c ail y . as <i TCaC^ 'U, . 

\ . Have vou do ve lof^: d any' .* • •: ^ . . . . • : -/ 1 -xr^ ; r.a tin? t U '*icl o v or- 
r.:nizutroyvxl if'^ilZa >: ' / i- ■■./.' TOf , iha:. you J^i >iot 



^J0\i think then*-: .'>^:iLr. :\ i .iriliti^c '^xLl .' c- ."^ UQe i<j wuu 
:>i 'J fur . iL.'>i'riorud rim'-fcK::', 



-it'r.ici pi:Le in cus'idculu^n da- 



V. Hno ydux' exvi'vicnc'-. 'j{th COT t'c,:n rei\ivdir,tj^. Lxpiain. 



ERIC 
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W}iich of t}:e follomr.g r'ethodts of funding projeata do you perspnally 
fcTJL and why 1 



\i. on the basis of proposals approved by the Department (as in EOF) 
iii. other (ple..'.sc specify) ' • 



Which of irhese methods i'o, in face, the most valuable and Dhy? 
(Probe: establish criteria for judgment). 



A2*e there any tipeci;'*i:; or..mnQ3 in the EOF prog7*am» policies and Vi'c\*adza^ec 
uJiiah would improve the quality anr: long't4irm produntivity of the pro,jecth 
[e.g. ci'iteriG Tw approval, mtchanitra for approval]. 



Do you think there 3 a ru .< ' for a^. EOF type program at the secondary 



fif "^es"! WL'''<L^ hi - L-'f.---:r ^he inteKtion of E0{" to p'X-vidc a more 
f^quitahle alhjimi it of fu i \- to the elnrientary 'h^vcl, .> fuTmula 
finanoinc nrer>i:^t\y favours tne secondary lev> i-f 



(if lo rhis :iK undet rcihle sitiuition^. ^ *? 



(if "i/e<3"] What .iuggestione or reoormendationr would you make to remedy 
the situation^ 



(the rao-o usual) formula financing 



levels 
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TITLE, of PROJECT: 



Af^LYSIS OF PROJECT DOCUHENTS 



I . CRITERIA ASSOCIATED Ul TH THE PROPOSAL 

I. Small classrooc project (corie as per matrix): 

■ti) ih-r,ervije *,'iucation oi' tecchers 

(b) additional cit:i:aroora teachers 

*. c} rii n -flier Leal uides to Eiupport teachers 

(d) brt-diilist nervicea reluted to classroom 

teacher 

f »' ) rtriterials for clastjrncm teacher 

( r) adni nirflrative/coordinating/pliianinK 
services 

otner ■ 



3. Hationais for ]n*ofp:tun 

in) p r- 1- l: r t / £ e n t T b ) c 1 e ar / ajnb i k^i • s 
'i. Objectives for proper 'irn 

in) r.tattd/iinstateJ (b) rieneral/sp'-'ci f ic (c) vajnie/clear 

5. Description of pro^rair 

' u) cont.ist^nt vi th cl jerrt i ve;^ : YOG/Tio/dcbattwlc 

"J , f H ) i"; fj t . i I e d [ :■ r o pr am bu d e t : Yc r. / Sn/deha tab I c 

(fc) AJ icj'.:at ..oil fcr eval'-.^^*. iof- : out of total budget of $ 



T • i d e r. j ( » p ro v : .Ic a ^ f 

(a: ;:-irf^n*. Gupp'. • - : Yes/tfo nature of ovidencp 



f.b) teai:df-r .^ipport: Yes/No r:a'.:ure ^if evidence 



( •) cjnmmuni*;.' Gijppr)ru: Yes/<\'o r.atijre nf tiviiec 



\-ri) Mr.-.* irift oi" propojnl roceived: Apfroval/Condrtioml Approval/ 

More tnformttoK required 
« ^: ! ' lo^-up on ^iV-ov'.^' dcimented/undocumented 

(c) ■:r\*,o^:n reJaxed by EOF ofl'ioo: Y^n/No 
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10. Evaluation ucait^ri Oviiuifurien^.. nrjpc^jLjr 

(a) aca.^ccu:: tic:hit.ve:ne.-.t ^.b) ^stadtTnt Ht.titude/opini'- r. oorv^y 

(c ) pre-T<:;st ) lencher att itude/opi r, . .rvey 

'e) aomir.: fitra* att • f-ido/wyf : nion survey 
(r) "^arer-v tir.titude/'opinior* survey 
(g) othe- 

r- 

i I - C .-^ITEJ^iA ASSOCIATED gJITH EVALUATlOfvl 

I • 

( \) out.c )T:.^.ii ob J or* i vt-a i j-.Tit 1 fite-J i ^'U , M 

\^:) iiir, n.t : :,T) 0 r r t- r. e c r. e t U'i i • • r : : •/;;-■ '/^i. I'.r? i< cji^ ; : • 

r. i'r-;,';rarr j:! ^.:::.iri*v 



t. a d / i 11 1'e r r ^ d / Uf i c 1 ear 
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(b; r;'iture cr ov:.5oa::e: .-pinions of t,eachers/adr:Lni3tr'itors/parents/ 

stu lontn/ottier 

Ic) opin^-cnc: >ioc'iriOnted/midoi:an;«ii:'.'d 

(j; i;'')i:rct:; ; 

(e) "hard" i:itn: Dt'iriiurdiied test3/pre--ost/contro]c/teacher 

constructed tests/either 




